You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/03/21 15:27:57 UTC
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1429
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1429/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230321142039",
"environmentId": "wIvstQNWBLbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-143202"
}
]
},
"name": "go-testxlang_partition-847",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/21 15:18:12 Submitted job: 2023-03-21_08_18_12-263203233574838875
2023/03/21 15:18:12 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-21_08_18_12-263203233574838875?project=apache-beam-testing
2023/03/21 15:18:12 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-21_08_18_12-263203233574838875
2023/03/21 15:18:12 Job state: JOB_STATE_PENDING ...
2023/03/21 15:18:43 Job still running ...
2023/03/21 15:19:13 Job still running ...
2023/03/21 15:19:43 Job still running ...
2023/03/21 15:20:13 Job still running ...
2023/03/21 15:20:43 Job still running ...
2023/03/21 15:21:13 Job still running ...
2023/03/21 15:21:43 Job still running ...
2023/03/21 15:22:13 Job still running ...
2023/03/21 15:22:43 Job still running ...
2023/03/21 15:23:13 Job still running ...
2023/03/21 15:23:43 Job still running ...
2023/03/21 15:24:13 Job still running ...
2023/03/21 15:24:43 Job still running ...
2023/03/21 15:25:13 Job still running ...
2023/03/21 15:25:43 Job still running ...
2023/03/21 15:26:14 Job still running ...
2023/03/21 15:26:44 Job still running ...
2023/03/21 15:27:14 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-21_08_18_12-263203233574838875 failed
--- FAIL: TestXLang_Partition (581.97s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3309.529s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679409158023238958
--- FAIL: TestBigQueryIO_BasicWriteRead (4.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46475 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@TjgbTkfCNy" is_bounded:BOUNDED windowing_strategy_id:"w0@TjgbTkfCNy"}} windowing_strategies:{key:"w0@TjgbTkfCNy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@TjgbTkfCNy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TjgbTkfCNy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@TjgbTkfCNy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679409158023238958\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"TjgbTkfCNy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3064)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2121)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46475 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@TjgbTkfCNy" is_bounded:BOUNDED windowing_strategy_id:"w0@TjgbTkfCNy"}} windowing_strategies:{key:"w0@TjgbTkfCNy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@TjgbTkfCNy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TjgbTkfCNy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@TjgbTkfCNy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679409158023238958\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"TjgbTkfCNy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3064)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2121)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0006943c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0006943c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e900?, 0xc0000bda40?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc000124a60, 0xf}, 0xc0004d5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e8a0?, 0xc0000bda40?}, {0xc000136300, 0x52}, {0x1?}, {0xc0004d5ea8, 0x2, 0x7ff230db0bb8?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000124a60, 0xf}, {0xc000136300, 0x52}, {0xebcb60, 0xc000125d70})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000102b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000102b60, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.471s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.038s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.039s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-143202
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-143202
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9c816214e69e7a0ff3bf23ca8055c6f2708ada8a563490ee59de3e935263f4b3
Deleted: sha256:9407a25e7c4bee1ccc1575e840d0b504fe49306a475b5cd352494c168623a8b7
Deleted: sha256:75a50aa9f1cd9de27313a3c20a3b188ed602b082c64bf51442137bd896f93be6
Deleted: sha256:40f01f77c56baeae666e801a0ea873a57824a0f0a4e0f9f96fa974dc0867292a
Deleted: sha256:0cc4dfc41d7b9144cee2a6bc88ada89d339eb152b7a8ab55d76617aebd7c717e
Deleted: sha256:dcdb9661dc0e1909c1b51db3abeb31ecef9a74319df049c3323a99b89e61728f
Deleted: sha256:5d8adc2c5669584f43bde30cd25638196404015ccb8eb057eefb12b269ece45b
Deleted: sha256:150b43c4eebf7b46159f6343fb6572e29e3ebb9c6c8af949b39fa85cad8b9d06
Deleted: sha256:e2342635aebd3bcb8a3bf952cd628f9cff7430c0375f234ce0f76a175bb7bbd5
Deleted: sha256:30b19b820b1218c25a6ff5fbfef561c959a8d5664d6de1d075faa21f41cd5360
Deleted: sha256:4426e91090c0d065c5dc3ee4766fb1b7e7a481956d0c91df633af49dca064d1e
Deleted: sha256:3f7a7254559651487a4f7253ce1c5433f5a36cf91beb700ad2b8d0f507337722
Deleted: sha256:95c759648881a88699d94022494735b6282f6f74cf06e0b9400b372ac8d35e0e
Deleted: sha256:48ecebc8a2bd0ec5c974d807c225e2ea211befff8aaeda2c17498c883a2794a7
Deleted: sha256:9f8f82d5c2f568fb38dad4c2cb575a3c25c75a20c2eeef55e89ab7ec4e3fb295
Deleted: sha256:a07ec0837729c690f4a4cda2e65b48eb36c3aeacb86491cb8c449bdbf9a7a9dc
Deleted: sha256:c768cafe374bddfadab29dc58244a36ddad783a3b709fb50a41dc30db641f1d9
Deleted: sha256:64ca498a423ebd68ee31494703e46a5c2de0f0ec45ca44cbf6e1b005a78fada2
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-143202
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9c816214e69e7a0ff3bf23ca8055c6f2708ada8a563490ee59de3e935263f4b3
Associated tags:
- 20230321-143202
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-143202
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-143202].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9c816214e69e7a0ff3bf23ca8055c6f2708ada8a563490ee59de3e935263f4b3].
$ rm -rf /tmp/tmp.TcZxv6Mmpn
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230321142039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5d6f74dbcb28add5eab8cf6e52f788f4f06ed6d696e0a7c61eecc527e0462c48
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230321142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5d6f74dbcb28add5eab8cf6e52f788f4f06ed6d696e0a7c61eecc527e0462c48]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230321142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5d6f74dbcb28add5eab8cf6e52f788f4f06ed6d696e0a7c61eecc527e0462c48])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5d6f74dbcb28add5eab8cf6e52f788f4f06ed6d696e0a7c61eecc527e0462c48
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5d6f74dbcb28add5eab8cf6e52f788f4f06ed6d696e0a7c61eecc527e0462c48
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5d6f74dbcb28add5eab8cf6e52f788f4f06ed6d696e0a7c61eecc527e0462c48].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230321142039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b5c03df909f7f98e727ac28e3cbbddf24c1963fde6b0588f41fd39acdce992e6
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230321142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b5c03df909f7f98e727ac28e3cbbddf24c1963fde6b0588f41fd39acdce992e6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230321142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b5c03df909f7f98e727ac28e3cbbddf24c1963fde6b0588f41fd39acdce992e6])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b5c03df909f7f98e727ac28e3cbbddf24c1963fde6b0588f41fd39acdce992e6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b5c03df909f7f98e727ac28e3cbbddf24c1963fde6b0588f41fd39acdce992e6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b5c03df909f7f98e727ac28e3cbbddf24c1963fde6b0588f41fd39acdce992e6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1467949.
Stopping expansion service pid: 1467950.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 30s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/snzqqqfszixlw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1680
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1680/display/redirect>
Changes:
------------------------------------------
[...truncated 1.31 MB...]
"tempStoragePrefix": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14104",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.49.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/worker",
"name": "worker"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/xlang/jaccess-cLw_6VKUXVSSR02qNdmHfiCEQC4xgO9cGkcXeJGoXLU.jar",
"name": "jaccess-cLw_6VKUXVSSR02qNdmHfiCEQC4xgO9cGkcXeJGoXLU.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/xlang/localedata-m64AoS_ttn_e9NIqwSVR0lu2Z1Z5ql2mff-rP_lcNFc.jar",
"name": "localedata-m64AoS_ttn_e9NIqwSVR0lu2Z1Z5ql2mff-rP_lcNFc.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/xlang/nashorn-N0Jsn4-u6InD0KSL1iQKJxisnjbN1yx2Il6jtukpLvI.jar",
"name": "nashorn-N0Jsn4-u6InD0KSL1iQKJxisnjbN1yx2Il6jtukpLvI.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/xlang/cldrdata-5EWPOR1vxHHNVt2c5NwrXn6onAk_PiwkFY34pXx-PXY.jar",
"name": "cldrdata-5EWPOR1vxHHNVt2c5NwrXn6onAk_PiwkFY34pXx-PXY.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/xlang/dnsns-WBg9XKwp_aXals1SHuDLDILJwBF0Qp8_Vs6ch4cmKVc.jar",
"name": "dnsns-WBg9XKwp_aXals1SHuDLDILJwBF0Qp8_Vs6ch4cmKVc.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-74dLmvpZIelu7JqFFumUUdarZp1glDrRMw5AuRjz6Y8.jar",
"name": "beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-74dLmvpZIelu7JqFFumUUdarZp1glDrRMw5AuRjz6Y8.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14104/go-2-1685068640854729845/xlang/icedtea-sound-Sx4pTbVkRyMN68Iwm-IRjHx-_IrVB7OJ04Hgf0GOshw.jar",
"name": "icedtea-sound-Sx4pTbVkRyMN68Iwm-IRjHx-_IrVB7OJ04Hgf0GOshw.jar"
}
],
"sdkHarnessContainerImages": [
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230526-023155",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230526022041",
"environmentId": "HiUqTFKinLbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230526-023155"
}
]
},
"name": "go-testbigqueryio_basicwriteread-40",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/26 02:37:29 Submitted job: 2023-05-25_19_37_29-11611640174436144064
2023/05/26 02:37:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-25_19_37_29-11611640174436144064?project=apache-beam-testing
2023/05/26 02:37:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-25_19_37_29-11611640174436144064
2023/05/26 02:37:29 Job state: JOB_STATE_PENDING ...
2023/05/26 02:37:59 Job still running ...
2023/05/26 02:38:29 Job still running ...
2023/05/26 02:38:59 Job still running ...
2023/05/26 02:39:29 Job still running ...
2023/05/26 02:39:59 Job still running ...
2023/05/26 02:40:29 Job still running ...
2023/05/26 02:40:59 Job still running ...
2023/05/26 02:41:29 Job still running ...
2023/05/26 02:42:00 Job still running ...
2023/05/26 02:42:30 Job still running ...
2023/05/26 02:43:00 Job 2023-05-25_19_37_29-11611640174436144064 succeeded!
bigquery_test.go:221: Deleting BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685068353421744822
--- PASS: TestBigQueryIO_BasicWriteRead (628.69s)
=== RUN TestBigQueryIO_BasicWriteQueryRead
integration.go:318: Test TestBigQueryIO_BasicWriteQueryRead is currently filtered for runner dataflow
--- SKIP: TestBigQueryIO_BasicWriteQueryRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 631.717s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230526-023155
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230526-023155
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:60d50a3848621141889179c0e2f85a1da9babf2b95dd606fc9e155b717fc3f4f
Deleted: sha256:61fe9f5c6c7ee57bc4385ddef98c60fb0e2705903b4716bfe93b8463d14e1203
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230526-023155
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:60d50a3848621141889179c0e2f85a1da9babf2b95dd606fc9e155b717fc3f4f
Associated tags:
- 20230526-023155
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230526-023155
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230526-023155].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:60d50a3848621141889179c0e2f85a1da9babf2b95dd606fc9e155b717fc3f4f].
$ rm -rf /tmp/tmp.zAfi2HVJMP
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230526022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dc7463ebf291196a420e08f8ef76e2e009576cb851b25bbf5050c26de5f309b3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230526022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dc7463ebf291196a420e08f8ef76e2e009576cb851b25bbf5050c26de5f309b3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230526022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dc7463ebf291196a420e08f8ef76e2e009576cb851b25bbf5050c26de5f309b3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dc7463ebf291196a420e08f8ef76e2e009576cb851b25bbf5050c26de5f309b3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dc7463ebf291196a420e08f8ef76e2e009576cb851b25bbf5050c26de5f309b3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dc7463ebf291196a420e08f8ef76e2e009576cb851b25bbf5050c26de5f309b3].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230526022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a0b0325f19efe6dc6018555326590992cd69a9c638d14af052dcbeb4ac43521b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230526022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a0b0325f19efe6dc6018555326590992cd69a9c638d14af052dcbeb4ac43521b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230526022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a0b0325f19efe6dc6018555326590992cd69a9c638d14af052dcbeb4ac43521b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4dd803c9fe8ef44f24cc813f5a17f1bb7b211e8431171a8b794c0b6f1f4984
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4dd803c9fe8ef44f24cc813f5a17f1bb7b211e8431171a8b794c0b6f1f4984
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4dd803c9fe8ef44f24cc813f5a17f1bb7b211e8431171a8b794c0b6f1f4984].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a0b0325f19efe6dc6018555326590992cd69a9c638d14af052dcbeb4ac43521b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a0b0325f19efe6dc6018555326590992cd69a9c638d14af052dcbeb4ac43521b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a0b0325f19efe6dc6018555326590992cd69a9c638d14af052dcbeb4ac43521b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1747569.
Stopping expansion service pid: 1747570.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 34s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/f6jfabjfjbuto
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1679
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1679/display/redirect>
Changes:
------------------------------------------
[...truncated 1.29 MB...]
"use_unified_worker",
"use_portable_job_submission"
],
"pipelineUrl": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test21559"
},
"beam:option:go_options:v1": {
"options": {
"bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp",
"expansion_addr": "[test:localhost:45383]",
"expansion_jar": "[io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.49.0-SNAPSHOT.jar> schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.49.0-SNAPSHOT.jar> debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.49.0-SNAPSHOT.jar> gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT.jar]",>
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"kafka_jar": "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.49.0-SNAPSHOT.jar",>
"sdk_harness_container_image_override": "[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525202041]",
"temp_location": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test21559",
"test.paniconexit0": "true",
"test.timeout": "3h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test21559",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.49.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/worker",
"name": "worker"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-74dLmvpZIelu7JqFFumUUdarZp1glDrRMw5AuRjz6Y8.jar",
"name": "beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-74dLmvpZIelu7JqFFumUUdarZp1glDrRMw5AuRjz6Y8.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/xlang/icedtea-sound-Sx4pTbVkRyMN68Iwm-IRjHx-_IrVB7OJ04Hgf0GOshw.jar",
"name": "icedtea-sound-Sx4pTbVkRyMN68Iwm-IRjHx-_IrVB7OJ04Hgf0GOshw.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/xlang/jaccess-cLw_6VKUXVSSR02qNdmHfiCEQC4xgO9cGkcXeJGoXLU.jar",
"name": "jaccess-cLw_6VKUXVSSR02qNdmHfiCEQC4xgO9cGkcXeJGoXLU.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/xlang/localedata-m64AoS_ttn_e9NIqwSVR0lu2Z1Z5ql2mff-rP_lcNFc.jar",
"name": "localedata-m64AoS_ttn_e9NIqwSVR0lu2Z1Z5ql2mff-rP_lcNFc.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/xlang/nashorn-N0Jsn4-u6InD0KSL1iQKJxisnjbN1yx2Il6jtukpLvI.jar",
"name": "nashorn-N0Jsn4-u6InD0KSL1iQKJxisnjbN1yx2Il6jtukpLvI.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/xlang/cldrdata-5EWPOR1vxHHNVt2c5NwrXn6onAk_PiwkFY34pXx-PXY.jar",
"name": "cldrdata-5EWPOR1vxHHNVt2c5NwrXn6onAk_PiwkFY34pXx-PXY.jar"
},
{
"location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test21559/go-2-1685047332458250420/xlang/dnsns-WBg9XKwp_aXals1SHuDLDILJwBF0Qp8_Vs6ch4cmKVc.jar",
"name": "dnsns-WBg9XKwp_aXals1SHuDLDILJwBF0Qp8_Vs6ch4cmKVc.jar"
}
],
"sdkHarnessContainerImages": [
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-203530",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525202041",
"environmentId": "rtLVUXREIIbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-203530"
}
]
},
"name": "go-testbigqueryio_basicwriteread-327",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/25 20:42:26 Submitted job: 2023-05-25_13_42_25-1027832387875978554
2023/05/25 20:42:26 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-25_13_42_25-1027832387875978554?project=apache-beam-testing
2023/05/25 20:42:26 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-25_13_42_25-1027832387875978554
2023/05/25 20:42:26 Job state: JOB_STATE_PENDING ...
2023/05/25 20:42:56 Job still running ...
2023/05/25 20:43:26 Job still running ...
2023/05/25 20:43:56 Job still running ...
2023/05/25 20:44:26 Job still running ...
2023/05/25 20:44:56 Job still running ...
2023/05/25 20:45:26 Job still running ...
2023/05/25 20:45:56 Job still running ...
2023/05/25 20:46:26 Job still running ...
2023/05/25 20:46:56 Job still running ...
2023/05/25 20:47:26 Job 2023-05-25_13_42_25-1027832387875978554 succeeded!
bigquery_test.go:221: Deleting BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685047018831409778
--- PASS: TestBigQueryIO_BasicWriteRead (631.06s)
=== RUN TestBigQueryIO_BasicWriteQueryRead
integration.go:318: Test TestBigQueryIO_BasicWriteQueryRead is currently filtered for runner dataflow
--- SKIP: TestBigQueryIO_BasicWriteQueryRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 634.166s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.114s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.095s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.111s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0d76e8ccf187727f082c18fcfd5f066d1c069b7ec0957bb433fbf0dc766ca159
Associated tags:
- 20230525-203530
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-203530
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-203530].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0d76e8ccf187727f082c18fcfd5f066d1c069b7ec0957bb433fbf0dc766ca159].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d0a26e08652797105a944d12f9300b2701bb40288bcf3ba4a2c83f43f40a6899]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d0a26e08652797105a944d12f9300b2701bb40288bcf3ba4a2c83f43f40a6899])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d0a26e08652797105a944d12f9300b2701bb40288bcf3ba4a2c83f43f40a6899
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d0a26e08652797105a944d12f9300b2701bb40288bcf3ba4a2c83f43f40a6899].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cd1c1491a9f160924ec7eca51b189f7a277708ae3e20d86d762c190c4a317ba]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cd1c1491a9f160924ec7eca51b189f7a277708ae3e20d86d762c190c4a317ba])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cd1c1491a9f160924ec7eca51b189f7a277708ae3e20d86d762c190c4a317ba
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9cd1c1491a9f160924ec7eca51b189f7a277708ae3e20d86d762c190c4a317ba].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 41s
232 actionable tasks: 164 executed, 56 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/qnqcsujueeiig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1678
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1678/display/redirect?page=changes>
Changes:
[noreply] update_grpc_router (#26843)
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-143146",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525142042",
"environmentId": "wkoftidtbibeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-143146"
}
]
},
"name": "go-testxlang_partition-205",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/25 15:13:45 Submitted job: 2023-05-25_08_13_44-5999842370797508677
2023/05/25 15:13:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-25_08_13_44-5999842370797508677?project=apache-beam-testing
2023/05/25 15:13:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-25_08_13_44-5999842370797508677
2023/05/25 15:13:45 Job state: JOB_STATE_PENDING ...
2023/05/25 15:14:15 Job still running ...
2023/05/25 15:14:45 Job still running ...
2023/05/25 15:15:15 Job still running ...
2023/05/25 15:15:45 Job still running ...
2023/05/25 15:16:15 Job still running ...
2023/05/25 15:16:45 Job still running ...
2023/05/25 15:17:15 Job still running ...
2023/05/25 15:17:45 Job still running ...
2023/05/25 15:18:15 Job still running ...
2023/05/25 15:18:45 Job still running ...
2023/05/25 15:19:15 Job still running ...
2023/05/25 15:19:46 Job still running ...
2023/05/25 15:20:16 Job still running ...
2023/05/25 15:20:46 Job still running ...
2023/05/25 15:21:16 Job still running ...
2023/05/25 15:21:46 Job still running ...
2023/05/25 15:22:16 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-25_08_13_44-5999842370797508677 failed
--- FAIL: TestXLang_Partition (551.15s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3029.767s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685025139743285073
--- FAIL: TestBigQueryIO_BasicWriteRead (4.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39771 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MVPHfCjxFe" is_bounded:BOUNDED windowing_strategy_id:"w0@MVPHfCjxFe"}} windowing_strategies:{key:"w0@MVPHfCjxFe" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MVPHfCjxFe" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MVPHfCjxFe" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MVPHfCjxFe" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685025139743285073\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MVPHfCjxFe"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39771 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MVPHfCjxFe" is_bounded:BOUNDED windowing_strategy_id:"w0@MVPHfCjxFe"}} windowing_strategies:{key:"w0@MVPHfCjxFe" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MVPHfCjxFe" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MVPHfCjxFe" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MVPHfCjxFe" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685025139743285073\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MVPHfCjxFe"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 14 [running]:
testing.tRunner.func1.2({0xfe3ac0, 0xc0005ae200})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe3ac0, 0xc0005ae200})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aa1e0?, 0xc00013c000?}, {0x11cc6ab, 0x39}, {0xc0001480c0?, 0x10cbc20?, 0x41bcd1?}, {0xc0006dbde0, 0xf}, 0xc00056bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aa040?, 0xc00013c000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc00056bea8, 0x2, 0xee33e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0006dbde0, 0xf}, {0xc000050f00, 0x52}, {0xf28000, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583860, 0x11ffb58)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.640s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f70821641c42ca7de166cd0f372551d611fbe01496410bcc3a9636d0ec4346ec
Associated tags:
- 20230525-143146
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-143146
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-143146].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f70821641c42ca7de166cd0f372551d611fbe01496410bcc3a9636d0ec4346ec].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525142042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:217bcd350a623b1e7cc33849f00b13d81621fa7fe622fdb4d14afee30124ff17]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525142042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:217bcd350a623b1e7cc33849f00b13d81621fa7fe622fdb4d14afee30124ff17])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:217bcd350a623b1e7cc33849f00b13d81621fa7fe622fdb4d14afee30124ff17
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:217bcd350a623b1e7cc33849f00b13d81621fa7fe622fdb4d14afee30124ff17].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525142042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:778beada65551b2080e499129114ebfeb83e614d0b69ff0d7a934baf01804ccd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525142042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:778beada65551b2080e499129114ebfeb83e614d0b69ff0d7a934baf01804ccd])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:778beada65551b2080e499129114ebfeb83e614d0b69ff0d7a934baf01804ccd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:778beada65551b2080e499129114ebfeb83e614d0b69ff0d7a934baf01804ccd].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 32s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/ax4kjchs53azi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1677
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1677/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-083248",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525082044",
"environmentId": "ftNJNmonBXbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-083248"
}
]
},
"name": "go-testxlang_partition-978",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/25 09:18:04 Submitted job: 2023-05-25_02_18_03-7799952983726472156
2023/05/25 09:18:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-25_02_18_03-7799952983726472156?project=apache-beam-testing
2023/05/25 09:18:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-25_02_18_03-7799952983726472156
2023/05/25 09:18:04 Job state: JOB_STATE_PENDING ...
2023/05/25 09:18:34 Job still running ...
2023/05/25 09:19:04 Job still running ...
2023/05/25 09:19:34 Job still running ...
2023/05/25 09:20:04 Job still running ...
2023/05/25 09:20:34 Job still running ...
2023/05/25 09:21:04 Job still running ...
2023/05/25 09:21:34 Job still running ...
2023/05/25 09:22:04 Job still running ...
2023/05/25 09:22:34 Job still running ...
2023/05/25 09:23:04 Job still running ...
2023/05/25 09:23:34 Job still running ...
2023/05/25 09:24:04 Job still running ...
2023/05/25 09:24:34 Job still running ...
2023/05/25 09:25:04 Job still running ...
2023/05/25 09:25:34 Job still running ...
2023/05/25 09:26:05 Job still running ...
2023/05/25 09:26:35 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-25_02_18_03-7799952983726472156 failed
--- FAIL: TestXLang_Partition (550.06s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3226.475s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685003601975352281
--- FAIL: TestBigQueryIO_BasicWriteRead (4.80s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43619 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JYSXsdVwHC" is_bounded:BOUNDED windowing_strategy_id:"w0@JYSXsdVwHC"}} windowing_strategies:{key:"w0@JYSXsdVwHC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JYSXsdVwHC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JYSXsdVwHC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JYSXsdVwHC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685003601975352281\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JYSXsdVwHC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43619 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JYSXsdVwHC" is_bounded:BOUNDED windowing_strategy_id:"w0@JYSXsdVwHC"}} windowing_strategies:{key:"w0@JYSXsdVwHC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JYSXsdVwHC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JYSXsdVwHC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JYSXsdVwHC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1685003601975352281\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JYSXsdVwHC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe3ac0, 0xc0005a43c0})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe3ac0, 0xc0005a43c0})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006540c0?, 0xc0000ec000?}, {0x11cc6ab, 0x39}, {0xc00012e0c0?, 0x10cbc20?, 0x41bcd1?}, {0xc000141dc0, 0xf}, 0xc000565d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000654040?, 0xc0000ec000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc000565ea8, 0x2, 0xee33e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000141dc0, 0xf}, {0xc000050f00, 0x52}, {0xf28000, 0xc000656018})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000581040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000581040, 0x11ffb58)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.827s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0d0c080e27786fa983e801a5db702be383a80e7620959d9454ffb579b1af8dad
Associated tags:
- 20230525-083248
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-083248
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-083248].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0d0c080e27786fa983e801a5db702be383a80e7620959d9454ffb579b1af8dad].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525082044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d7f47414847a34be2b1dee44098ccbb265fd0be8a74728d57b20f2da8b50e3a4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525082044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d7f47414847a34be2b1dee44098ccbb265fd0be8a74728d57b20f2da8b50e3a4])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d7f47414847a34be2b1dee44098ccbb265fd0be8a74728d57b20f2da8b50e3a4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d7f47414847a34be2b1dee44098ccbb265fd0be8a74728d57b20f2da8b50e3a4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525082044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ac6ad7da54d4af00d31655f0b06a951d52d124a9e733221eb13c82fa335580a1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525082044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ac6ad7da54d4af00d31655f0b06a951d52d124a9e733221eb13c82fa335580a1])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ac6ad7da54d4af00d31655f0b06a951d52d124a9e733221eb13c82fa335580a1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ac6ad7da54d4af00d31655f0b06a951d52d124a9e733221eb13c82fa335580a1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 50s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/ed63q77o7bdim
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1676
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1676/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-023218",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-023218"
}
]
},
"name": "go-testxlang_partition-926",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/25 03:16:51 Submitted job: 2023-05-24_20_16_51-4543239871678211312
2023/05/25 03:16:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-24_20_16_51-4543239871678211312?project=apache-beam-testing
2023/05/25 03:16:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-24_20_16_51-4543239871678211312
2023/05/25 03:16:51 Job state: JOB_STATE_PENDING ...
2023/05/25 03:17:21 Job still running ...
2023/05/25 03:17:51 Job still running ...
2023/05/25 03:18:21 Job still running ...
2023/05/25 03:18:51 Job still running ...
2023/05/25 03:19:21 Job still running ...
2023/05/25 03:19:51 Job still running ...
2023/05/25 03:20:21 Job still running ...
2023/05/25 03:20:52 Job still running ...
2023/05/25 03:21:22 Job still running ...
2023/05/25 03:21:52 Job still running ...
2023/05/25 03:22:22 Job still running ...
2023/05/25 03:22:52 Job still running ...
2023/05/25 03:23:22 Job still running ...
2023/05/25 03:23:52 Job still running ...
2023/05/25 03:24:22 Job still running ...
2023/05/25 03:24:52 Job still running ...
2023/05/25 03:25:22 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-24_20_16_51-4543239871678211312 failed
--- FAIL: TestXLang_Partition (550.24s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3183.199s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684981972435357452
--- FAIL: TestBigQueryIO_BasicWriteRead (4.57s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34755 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WvjVCvMdgb" is_bounded:BOUNDED windowing_strategy_id:"w0@WvjVCvMdgb"}} windowing_strategies:{key:"w0@WvjVCvMdgb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WvjVCvMdgb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WvjVCvMdgb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WvjVCvMdgb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684981972435357452\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WvjVCvMdgb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34755 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WvjVCvMdgb" is_bounded:BOUNDED windowing_strategy_id:"w0@WvjVCvMdgb"}} windowing_strategies:{key:"w0@WvjVCvMdgb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WvjVCvMdgb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WvjVCvMdgb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WvjVCvMdgb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684981972435357452\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WvjVCvMdgb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe3ac0, 0xc000216740})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe3ac0, 0xc000216740})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aaaa0?, 0xc0000c02d0?}, {0x11cc6ab, 0x39}, {0xc0000f4180?, 0x10cbc20?, 0x1?}, {0xc00046d700, 0xf}, 0xc000565d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aaa00?, 0xc0000c02d0?}, {0xc000050c00, 0x52}, {0x1?}, {0xc000565ea8, 0x2, 0xee33e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046d700, 0xf}, {0xc000050c00, 0x52}, {0xf28000, 0xc0001394c8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001036c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001036c0, 0x11ffb58)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.595s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-023218
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-023218
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0e41c2200759c2c800f38cb4519cf4c29d8ab275331234af5bd56fdebdc8a54a
Deleted: sha256:12cba30831f144693ce94ee8ae6466b56d32fd487365e1ea49e6c6d15daa55ee
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-023218
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0e41c2200759c2c800f38cb4519cf4c29d8ab275331234af5bd56fdebdc8a54a
Associated tags:
- 20230525-023218
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-023218
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230525-023218].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0e41c2200759c2c800f38cb4519cf4c29d8ab275331234af5bd56fdebdc8a54a].
$ rm -rf /tmp/tmp.3SLkhXTzLp
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6523bc89b1e98720df228111370b5285f64ea6c61db7d6ac5b2100825aaddb63
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6523bc89b1e98720df228111370b5285f64ea6c61db7d6ac5b2100825aaddb63]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230525022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6523bc89b1e98720df228111370b5285f64ea6c61db7d6ac5b2100825aaddb63])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6523bc89b1e98720df228111370b5285f64ea6c61db7d6ac5b2100825aaddb63
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6523bc89b1e98720df228111370b5285f64ea6c61db7d6ac5b2100825aaddb63
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6523bc89b1e98720df228111370b5285f64ea6c61db7d6ac5b2100825aaddb63].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dce6a283b048e1082c455bcd6db45dfb6818116ff1f3a28dec5b2d5854e7aa4c
Deleted: sha256:f8c1d61d89f5277b640dd98c10d4104d6c66714bff7066ece7be18c954504d49
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dce6a283b048e1082c455bcd6db45dfb6818116ff1f3a28dec5b2d5854e7aa4c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230525022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dce6a283b048e1082c455bcd6db45dfb6818116ff1f3a28dec5b2d5854e7aa4c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dce6a283b048e1082c455bcd6db45dfb6818116ff1f3a28dec5b2d5854e7aa4c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dce6a283b048e1082c455bcd6db45dfb6818116ff1f3a28dec5b2d5854e7aa4c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dce6a283b048e1082c455bcd6db45dfb6818116ff1f3a28dec5b2d5854e7aa4c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 325027.
Stopping expansion service pid: 325028.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 39s
232 actionable tasks: 153 executed, 67 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/yasphh5k3232q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1675
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1675/display/redirect?page=changes>
Changes:
[noreply] Implement a fast (lcg) random generator for Python SyntheticSource
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524202030",
"environmentId": "XgQCzVzNPhbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-203204",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-203204"
}
]
},
"name": "go-testxlang_partition-462",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/24 21:17:42 Submitted job: 2023-05-24_14_17_42-16513523284658484155
2023/05/24 21:17:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-24_14_17_42-16513523284658484155?project=apache-beam-testing
2023/05/24 21:17:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-24_14_17_42-16513523284658484155
2023/05/24 21:17:42 Job state: JOB_STATE_PENDING ...
2023/05/24 21:18:13 Job still running ...
2023/05/24 21:18:43 Job still running ...
2023/05/24 21:19:13 Job still running ...
2023/05/24 21:19:43 Job still running ...
2023/05/24 21:20:13 Job still running ...
2023/05/24 21:20:43 Job still running ...
2023/05/24 21:21:13 Job still running ...
2023/05/24 21:21:43 Job still running ...
2023/05/24 21:22:13 Job still running ...
2023/05/24 21:22:43 Job still running ...
2023/05/24 21:23:13 Job still running ...
2023/05/24 21:23:43 Job still running ...
2023/05/24 21:24:13 Job still running ...
2023/05/24 21:24:43 Job still running ...
2023/05/24 21:25:13 Job still running ...
2023/05/24 21:25:43 Job still running ...
2023/05/24 21:26:13 Job still running ...
2023/05/24 21:26:43 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-24_14_17_42-16513523284658484155 failed
--- FAIL: TestXLang_Partition (581.57s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3273.708s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684960366887262374
--- FAIL: TestBigQueryIO_BasicWriteRead (4.84s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35777 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oZAbzxcnSn" is_bounded:BOUNDED windowing_strategy_id:"w0@oZAbzxcnSn"}} windowing_strategies:{key:"w0@oZAbzxcnSn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oZAbzxcnSn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oZAbzxcnSn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oZAbzxcnSn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684960366887262374\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oZAbzxcnSn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35777 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oZAbzxcnSn" is_bounded:BOUNDED windowing_strategy_id:"w0@oZAbzxcnSn"}} windowing_strategies:{key:"w0@oZAbzxcnSn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oZAbzxcnSn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oZAbzxcnSn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oZAbzxcnSn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684960366887262374\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oZAbzxcnSn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 40 [running]:
testing.tRunner.func1.2({0xfe3ac0, 0xc0002b8840})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe3ac0, 0xc0002b8840})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00052e0a0?, 0xc000530000?}, {0x11cc6ab, 0x39}, {0xc0000f4180?, 0x10cbc20?, 0x41bcd1?}, {0xc00046dbb0, 0xf}, 0xc000285d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00052e020?, 0xc000530000?}, {0xc000050d20, 0x52}, {0x1?}, {0xc000285ea8, 0x2, 0xee33e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dbb0, 0xf}, {0xc000050d20, 0x52}, {0xf28000, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d9ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d9ba0, 0x11ffb58)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.870s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d4616c658bcf15dd9723fa5d7d94400b846d79930abd08a63e011e66e4b6e218
Associated tags:
- 20230524-203204
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-203204
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-203204].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d4616c658bcf15dd9723fa5d7d94400b846d79930abd08a63e011e66e4b6e218].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524202030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9671f8730b4b58ed8093e6656fa8884d4fe65281cea5013c6e2fd73a3105ba46]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524202030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9671f8730b4b58ed8093e6656fa8884d4fe65281cea5013c6e2fd73a3105ba46])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9671f8730b4b58ed8093e6656fa8884d4fe65281cea5013c6e2fd73a3105ba46
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9671f8730b4b58ed8093e6656fa8884d4fe65281cea5013c6e2fd73a3105ba46].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524202030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:749b14a6f7b6d9b242a49436a3ab4ecd13e985ccda9f22ea012bfb64006b2bc9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524202030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:749b14a6f7b6d9b242a49436a3ab4ecd13e985ccda9f22ea012bfb64006b2bc9])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:749b14a6f7b6d9b242a49436a3ab4ecd13e985ccda9f22ea012bfb64006b2bc9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:749b14a6f7b6d9b242a49436a3ab4ecd13e985ccda9f22ea012bfb64006b2bc9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 12s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/xvhflml36kya4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1674
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1674/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-143137",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524142047",
"environmentId": "IlhPuvSDMPbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-143137"
}
]
},
"name": "go-testxlang_partition-265",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/24 15:16:11 Submitted job: 2023-05-24_08_16_08-14758478097857583682
2023/05/24 15:16:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-24_08_16_08-14758478097857583682?project=apache-beam-testing
2023/05/24 15:16:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-24_08_16_08-14758478097857583682
2023/05/24 15:16:11 Job state: JOB_STATE_PENDING ...
2023/05/24 15:16:41 Job still running ...
2023/05/24 15:17:11 Job still running ...
2023/05/24 15:17:41 Job still running ...
2023/05/24 15:18:11 Job still running ...
2023/05/24 15:18:42 Job still running ...
2023/05/24 15:19:12 Job still running ...
2023/05/24 15:19:42 Job still running ...
2023/05/24 15:20:12 Job still running ...
2023/05/24 15:20:42 Job still running ...
2023/05/24 15:21:12 Job still running ...
2023/05/24 15:21:42 Job still running ...
2023/05/24 15:22:12 Job still running ...
2023/05/24 15:22:42 Job still running ...
2023/05/24 15:23:12 Job still running ...
2023/05/24 15:23:42 Job still running ...
2023/05/24 15:24:12 Job still running ...
2023/05/24 15:24:42 Job still running ...
2023/05/24 15:25:12 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-24_08_16_08-14758478097857583682 failed
--- FAIL: TestXLang_Partition (584.29s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3214.937s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684938730827318024
--- FAIL: TestBigQueryIO_BasicWriteRead (4.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38333 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bacGJREDCk" is_bounded:BOUNDED windowing_strategy_id:"w0@bacGJREDCk"}} windowing_strategies:{key:"w0@bacGJREDCk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bacGJREDCk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bacGJREDCk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bacGJREDCk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684938730827318024\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bacGJREDCk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38333 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bacGJREDCk" is_bounded:BOUNDED windowing_strategy_id:"w0@bacGJREDCk"}} windowing_strategies:{key:"w0@bacGJREDCk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bacGJREDCk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bacGJREDCk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bacGJREDCk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684938730827318024\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bacGJREDCk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc0000b4cc0})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc0000b4cc0})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aa100?, 0xc0006c0050?}, {0x11cb22a, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000489f40, 0xf}, 0xc00028fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aa080?, 0xc0006c0050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc00028fea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f40, 0xf}, {0xc00010ec00, 0x52}, {0xf26ee0, 0xc0006a6048})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000582d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000582d00, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.632s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:330615ebbca9efad14fa418b1f543974308b0e7b150e46ba1e1aa37fcdb96718
Associated tags:
- 20230524-143137
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-143137
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-143137].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:330615ebbca9efad14fa418b1f543974308b0e7b150e46ba1e1aa37fcdb96718].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524142047]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f3cf4f9666266436df217e2edd59ee353c4eecb08236d38bcf42b0e33cb8cb9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524142047] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f3cf4f9666266436df217e2edd59ee353c4eecb08236d38bcf42b0e33cb8cb9])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f3cf4f9666266436df217e2edd59ee353c4eecb08236d38bcf42b0e33cb8cb9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f3cf4f9666266436df217e2edd59ee353c4eecb08236d38bcf42b0e33cb8cb9].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524142047]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cff19db0f26a67c132427dfbfcf9f2f5cc4dd8634a38beba7e4887586909339f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524142047] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cff19db0f26a67c132427dfbfcf9f2f5cc4dd8634a38beba7e4887586909339f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cff19db0f26a67c132427dfbfcf9f2f5cc4dd8634a38beba7e4887586909339f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cff19db0f26a67c132427dfbfcf9f2f5cc4dd8634a38beba7e4887586909339f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 22s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/6m7ctz7v6k4ue
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1673
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1673/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524082030",
"environmentId": "OHFTNqysnhbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-083120"
}
]
},
"name": "go-testxlang_partition-53",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/24 09:15:24 Submitted job: 2023-05-24_02_15_23-4664090908597577667
2023/05/24 09:15:24 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-24_02_15_23-4664090908597577667?project=apache-beam-testing
2023/05/24 09:15:24 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-24_02_15_23-4664090908597577667
2023/05/24 09:15:24 Job state: JOB_STATE_PENDING ...
2023/05/24 09:15:54 Job still running ...
2023/05/24 09:16:24 Job still running ...
2023/05/24 09:16:54 Job still running ...
2023/05/24 09:17:24 Job still running ...
2023/05/24 09:17:54 Job still running ...
2023/05/24 09:18:24 Job still running ...
2023/05/24 09:18:54 Job still running ...
2023/05/24 09:19:24 Job still running ...
2023/05/24 09:19:54 Job still running ...
2023/05/24 09:20:24 Job still running ...
2023/05/24 09:20:54 Job still running ...
2023/05/24 09:21:24 Job still running ...
2023/05/24 09:21:54 Job still running ...
2023/05/24 09:22:24 Job still running ...
2023/05/24 09:22:54 Job still running ...
2023/05/24 09:23:24 Job still running ...
2023/05/24 09:23:54 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-24_02_15_23-4664090908597577667 failed
--- FAIL: TestXLang_Partition (550.59s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3151.788s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684917116248338268
--- FAIL: TestBigQueryIO_BasicWriteRead (4.71s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40031 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oQlcPeDHhu" is_bounded:BOUNDED windowing_strategy_id:"w0@oQlcPeDHhu"}} windowing_strategies:{key:"w0@oQlcPeDHhu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oQlcPeDHhu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oQlcPeDHhu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oQlcPeDHhu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684917116248338268\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oQlcPeDHhu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40031 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oQlcPeDHhu" is_bounded:BOUNDED windowing_strategy_id:"w0@oQlcPeDHhu"}} windowing_strategies:{key:"w0@oQlcPeDHhu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oQlcPeDHhu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oQlcPeDHhu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oQlcPeDHhu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684917116248338268\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oQlcPeDHhu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc00066a440})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc00066a440})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e0c0?, 0xc000534000?}, {0x11cb22a, 0x39}, {0xc0005420c0?, 0x10ca800?, 0x41bcd1?}, {0xc00046bea0, 0xf}, 0xc00017dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc000534000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc00017dea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046bea0, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d9a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d9a00, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.734s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-083120
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-083120
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0b1f79e382022cb5d06f69a34d2531caba0e3eb9be14e74809820279ad81c306
Deleted: sha256:097e170de2620c3d0d431be99d807ca3240e68b451ec23f3c523902c7f3012c5
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-083120
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0b1f79e382022cb5d06f69a34d2531caba0e3eb9be14e74809820279ad81c306
Associated tags:
- 20230524-083120
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-083120
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-083120].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0b1f79e382022cb5d06f69a34d2531caba0e3eb9be14e74809820279ad81c306].
$ rm -rf /tmp/tmp.GubZvcOW59
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524082030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3faff4dc912df31a778b765102d272686488618ea6144006bbf302b68730ba34
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524082030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3faff4dc912df31a778b765102d272686488618ea6144006bbf302b68730ba34]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524082030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3faff4dc912df31a778b765102d272686488618ea6144006bbf302b68730ba34])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3faff4dc912df31a778b765102d272686488618ea6144006bbf302b68730ba34
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3faff4dc912df31a778b765102d272686488618ea6144006bbf302b68730ba34
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3faff4dc912df31a778b765102d272686488618ea6144006bbf302b68730ba34].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524082030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63a4b41ab097b85dc4278faad47a229636ab87e72690c2308b140ecf38eea7af
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524082030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63a4b41ab097b85dc4278faad47a229636ab87e72690c2308b140ecf38eea7af]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524082030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63a4b41ab097b85dc4278faad47a229636ab87e72690c2308b140ecf38eea7af])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63a4b41ab097b85dc4278faad47a229636ab87e72690c2308b140ecf38eea7af
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63a4b41ab097b85dc4278faad47a229636ab87e72690c2308b140ecf38eea7af
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63a4b41ab097b85dc4278faad47a229636ab87e72690c2308b140ecf38eea7af].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3557042.
Stopping expansion service pid: 3557043.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 22s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/v3fzuyohda3z2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1672
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1672/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524022039",
"environmentId": "YIiqnPcAfUbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-023151"
}
]
},
"name": "go-testxlang_partition-101",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/24 03:16:17 Submitted job: 2023-05-23_20_16_17-5038544482924260385
2023/05/24 03:16:17 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-23_20_16_17-5038544482924260385?project=apache-beam-testing
2023/05/24 03:16:17 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-23_20_16_17-5038544482924260385
2023/05/24 03:16:17 Job state: JOB_STATE_PENDING ...
2023/05/24 03:16:47 Job still running ...
2023/05/24 03:17:17 Job still running ...
2023/05/24 03:17:47 Job still running ...
2023/05/24 03:18:17 Job still running ...
2023/05/24 03:18:47 Job still running ...
2023/05/24 03:19:17 Job still running ...
2023/05/24 03:19:48 Job still running ...
2023/05/24 03:20:18 Job still running ...
2023/05/24 03:20:48 Job still running ...
2023/05/24 03:21:18 Job still running ...
2023/05/24 03:21:48 Job still running ...
2023/05/24 03:22:18 Job still running ...
2023/05/24 03:22:48 Job still running ...
2023/05/24 03:23:18 Job still running ...
2023/05/24 03:23:48 Job still running ...
2023/05/24 03:24:18 Job still running ...
2023/05/24 03:24:48 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-23_20_16_17-5038544482924260385 failed
--- FAIL: TestXLang_Partition (551.26s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3169.244s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684895552456510729
--- FAIL: TestBigQueryIO_BasicWriteRead (5.85s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43491 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uiajXOTZZe" is_bounded:BOUNDED windowing_strategy_id:"w0@uiajXOTZZe"}} windowing_strategies:{key:"w0@uiajXOTZZe" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uiajXOTZZe" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uiajXOTZZe" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uiajXOTZZe" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684895552456510729\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uiajXOTZZe"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43491 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uiajXOTZZe" is_bounded:BOUNDED windowing_strategy_id:"w0@uiajXOTZZe"}} windowing_strategies:{key:"w0@uiajXOTZZe" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uiajXOTZZe" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uiajXOTZZe" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uiajXOTZZe" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684895552456510729\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uiajXOTZZe"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000128680})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000128680})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00070e0c0?, 0xc000620000?}, {0x11cb22a, 0x39}, {0xc0006280c0?, 0x10ca800?, 0x41bcd1?}, {0xc000139de0, 0xf}, 0xc00056bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00070e040?, 0xc000620000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc00056bea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000139de0, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000603040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000603040, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.882s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-023151
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-023151
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8cd606402c5058b76a6de5cb794831b261600ce0dbf2c73f4ee140d608ec8545
Deleted: sha256:70f323f3fab10c554ab2da7d5dad889970d7f6656986e942f8ee299c0a24929f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-023151
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8cd606402c5058b76a6de5cb794831b261600ce0dbf2c73f4ee140d608ec8545
Associated tags:
- 20230524-023151
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-023151
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230524-023151].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8cd606402c5058b76a6de5cb794831b261600ce0dbf2c73f4ee140d608ec8545].
$ rm -rf /tmp/tmp.8fwEo2byHA
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524022039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4d42f9afade4a352dfe26715e8e15f57a77a40984af7989c9a76b230fdaf034
Deleted: sha256:81c2c81340cde6f5a5bd7760acd263158a52c54a3a95016bb524336f35ecd69a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4d42f9afade4a352dfe26715e8e15f57a77a40984af7989c9a76b230fdaf034]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230524022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4d42f9afade4a352dfe26715e8e15f57a77a40984af7989c9a76b230fdaf034])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4d42f9afade4a352dfe26715e8e15f57a77a40984af7989c9a76b230fdaf034
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4d42f9afade4a352dfe26715e8e15f57a77a40984af7989c9a76b230fdaf034
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4d42f9afade4a352dfe26715e8e15f57a77a40984af7989c9a76b230fdaf034].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524022039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a229eab60cf71bba321f785708b03e04639acba77b83cc5d988fe9161628907
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a229eab60cf71bba321f785708b03e04639acba77b83cc5d988fe9161628907]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230524022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a229eab60cf71bba321f785708b03e04639acba77b83cc5d988fe9161628907])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a229eab60cf71bba321f785708b03e04639acba77b83cc5d988fe9161628907
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a229eab60cf71bba321f785708b03e04639acba77b83cc5d988fe9161628907
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a229eab60cf71bba321f785708b03e04639acba77b83cc5d988fe9161628907].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3415462.
Stopping expansion service pid: 3415463.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 5s
232 actionable tasks: 165 executed, 57 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/hisw5rybkv7lq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1671
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1671/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"environmentId": "MWVcpiNBoGbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-211309",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-211309"
}
]
},
"name": "go-testxlang_partition-633",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/23 21:58:19 Submitted job: 2023-05-23_14_58_18-1815280683572972980
2023/05/23 21:58:19 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-23_14_58_18-1815280683572972980?project=apache-beam-testing
2023/05/23 21:58:19 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-23_14_58_18-1815280683572972980
2023/05/23 21:58:19 Job state: JOB_STATE_PENDING ...
2023/05/23 21:58:49 Job still running ...
2023/05/23 21:59:19 Job still running ...
2023/05/23 21:59:49 Job still running ...
2023/05/23 22:00:19 Job still running ...
2023/05/23 22:00:49 Job still running ...
2023/05/23 22:01:19 Job still running ...
2023/05/23 22:01:49 Job still running ...
2023/05/23 22:02:19 Job still running ...
2023/05/23 22:02:49 Job still running ...
2023/05/23 22:03:19 Job still running ...
2023/05/23 22:03:49 Job still running ...
2023/05/23 22:04:19 Job still running ...
2023/05/23 22:04:49 Job still running ...
2023/05/23 22:05:19 Job still running ...
2023/05/23 22:05:49 Job still running ...
2023/05/23 22:06:19 Job still running ...
2023/05/23 22:06:49 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-23_14_58_18-1815280683572972980 failed
--- FAIL: TestXLang_Partition (550.00s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3212.840s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684876437843644763
--- FAIL: TestBigQueryIO_BasicWriteRead (6.71s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45101 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@TFYSBezbbZ" is_bounded:BOUNDED windowing_strategy_id:"w0@TFYSBezbbZ"}} windowing_strategies:{key:"w0@TFYSBezbbZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@TFYSBezbbZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TFYSBezbbZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@TFYSBezbbZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684876437843644763\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"TFYSBezbbZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45101 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@TFYSBezbbZ" is_bounded:BOUNDED windowing_strategy_id:"w0@TFYSBezbbZ"}} windowing_strategies:{key:"w0@TFYSBezbbZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@TFYSBezbbZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TFYSBezbbZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@TFYSBezbbZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684876437843644763\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"TFYSBezbbZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:229)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000140000})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000140000})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000732340?, 0xc0000c02d0?}, {0x11cb22a, 0x39}, {0xc0000f4240?, 0x10ca800?, 0x1?}, {0xc00046be10, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0007322c0?, 0xc0000c02d0?}, {0xc000050f00, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046be10, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc0007074d8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583520, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.741s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.081s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-211309
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-211309
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:962b7da54cc9934084c7d38eb7f65c6be309aef300a7a7bc3f79d2a471c73829
Deleted: sha256:c6c0f88e3a50581aaf7a20204ae629f60f084791e7d841798af35199412e6544
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-211309
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:962b7da54cc9934084c7d38eb7f65c6be309aef300a7a7bc3f79d2a471c73829
Associated tags:
- 20230523-211309
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-211309
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-211309].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:962b7da54cc9934084c7d38eb7f65c6be309aef300a7a7bc3f79d2a471c73829].
$ rm -rf /tmp/tmp.e5JWDtTARq
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523210128
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f498165d36718aaeb3e8588792f7003f9a05713dc12efcafb4fac41ca9a16594
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523210128]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f498165d36718aaeb3e8588792f7003f9a05713dc12efcafb4fac41ca9a16594]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523210128] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f498165d36718aaeb3e8588792f7003f9a05713dc12efcafb4fac41ca9a16594])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f498165d36718aaeb3e8588792f7003f9a05713dc12efcafb4fac41ca9a16594
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f498165d36718aaeb3e8588792f7003f9a05713dc12efcafb4fac41ca9a16594
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f498165d36718aaeb3e8588792f7003f9a05713dc12efcafb4fac41ca9a16594].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523210128
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64d5ff6a48ae1cdfbd6e3897eeaece7ddfce4d822f14014300243c6167fce932
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523210128]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64d5ff6a48ae1cdfbd6e3897eeaece7ddfce4d822f14014300243c6167fce932]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523210128] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64d5ff6a48ae1cdfbd6e3897eeaece7ddfce4d822f14014300243c6167fce932])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64d5ff6a48ae1cdfbd6e3897eeaece7ddfce4d822f14014300243c6167fce932
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64d5ff6a48ae1cdfbd6e3897eeaece7ddfce4d822f14014300243c6167fce932
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64d5ff6a48ae1cdfbd6e3897eeaece7ddfce4d822f14014300243c6167fce932].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2516216.
Stopping expansion service pid: 2516217.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 22s
232 actionable tasks: 170 executed, 50 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/icvuy2w5mfkj4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1670
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1670/display/redirect?page=changes>
Changes:
[noreply] Bump requests (#26828)
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523142033",
"environmentId": "yAlpERCxtIbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-143253"
}
]
},
"name": "go-testxlang_partition-15",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/23 15:19:46 Submitted job: 2023-05-23_08_19_45-8276118657439379184
2023/05/23 15:19:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-23_08_19_45-8276118657439379184?project=apache-beam-testing
2023/05/23 15:19:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-23_08_19_45-8276118657439379184
2023/05/23 15:19:46 Job state: JOB_STATE_PENDING ...
2023/05/23 15:20:16 Job still running ...
2023/05/23 15:20:46 Job still running ...
2023/05/23 15:21:16 Job still running ...
2023/05/23 15:21:46 Job still running ...
2023/05/23 15:22:16 Job still running ...
2023/05/23 15:22:46 Job still running ...
2023/05/23 15:23:16 Job still running ...
2023/05/23 15:23:46 Job still running ...
2023/05/23 15:24:16 Job still running ...
2023/05/23 15:24:46 Job still running ...
2023/05/23 15:25:16 Job still running ...
2023/05/23 15:25:46 Job still running ...
2023/05/23 15:26:16 Job still running ...
2023/05/23 15:26:46 Job still running ...
2023/05/23 15:27:16 Job still running ...
2023/05/23 15:27:46 Job still running ...
2023/05/23 15:28:16 Job still running ...
2023/05/23 15:28:46 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-23_08_19_45-8276118657439379184 failed
--- FAIL: TestXLang_Partition (580.24s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3341.061s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684852426693189980
--- FAIL: TestBigQueryIO_BasicWriteRead (7.04s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37789 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EOuECeWAvq" is_bounded:BOUNDED windowing_strategy_id:"w0@EOuECeWAvq"}} windowing_strategies:{key:"w0@EOuECeWAvq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EOuECeWAvq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EOuECeWAvq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EOuECeWAvq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684852426693189980\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EOuECeWAvq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37789 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EOuECeWAvq" is_bounded:BOUNDED windowing_strategy_id:"w0@EOuECeWAvq"}} windowing_strategies:{key:"w0@EOuECeWAvq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EOuECeWAvq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EOuECeWAvq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EOuECeWAvq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684852426693189980\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EOuECeWAvq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 14 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000270940})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000270940})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005c4340?, 0xc0000c02d0?}, {0x11cb22a, 0x39}, {0xc0000f4180?, 0x10ca800?, 0x1?}, {0xc00059bde0, 0xf}, 0xc000577d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010ff80?, 0xc0000c02d0?}, {0xc0005dc7e0, 0x52}, {0x1?}, {0xc000577ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00059bde0, 0xf}, {0xc0005dc7e0, 0x52}, {0xf26ee0, 0xc00046d4d8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103380, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 10.067s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.044s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.034s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-143253
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-143253
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:438939e92e111dca73aabfd8c9c26e334698c2138af2beb30b8cf3db69149d5c
Deleted: sha256:d066f6c5b2788ea46a643ef728468780296ca9a24a47f00591cf21ae46012cfa
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-143253
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:438939e92e111dca73aabfd8c9c26e334698c2138af2beb30b8cf3db69149d5c
Associated tags:
- 20230523-143253
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-143253
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-143253].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:438939e92e111dca73aabfd8c9c26e334698c2138af2beb30b8cf3db69149d5c].
$ rm -rf /tmp/tmp.tk1rUrakt9
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0c1b68ddfe848f57c92b84a3f94d025047caee58bdb9a2aa733930d175d489c7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0c1b68ddfe848f57c92b84a3f94d025047caee58bdb9a2aa733930d175d489c7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0c1b68ddfe848f57c92b84a3f94d025047caee58bdb9a2aa733930d175d489c7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0c1b68ddfe848f57c92b84a3f94d025047caee58bdb9a2aa733930d175d489c7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0c1b68ddfe848f57c92b84a3f94d025047caee58bdb9a2aa733930d175d489c7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0c1b68ddfe848f57c92b84a3f94d025047caee58bdb9a2aa733930d175d489c7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7df9e3bbe7e648b2a29a8d169a5df88fdaf9431e508a7b7e09f192e61a848e4a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7df9e3bbe7e648b2a29a8d169a5df88fdaf9431e508a7b7e09f192e61a848e4a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7df9e3bbe7e648b2a29a8d169a5df88fdaf9431e508a7b7e09f192e61a848e4a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7df9e3bbe7e648b2a29a8d169a5df88fdaf9431e508a7b7e09f192e61a848e4a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7df9e3bbe7e648b2a29a8d169a5df88fdaf9431e508a7b7e09f192e61a848e4a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7df9e3bbe7e648b2a29a8d169a5df88fdaf9431e508a7b7e09f192e61a848e4a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2789534.
Stopping expansion service pid: 2789535.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 12s
232 actionable tasks: 162 executed, 58 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/muglyyujn2r5k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1669
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1669/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523082040",
"environmentId": "ByFLHbWkGebeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-083155"
}
]
},
"name": "go-testxlang_partition-614",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/23 09:14:57 Submitted job: 2023-05-23_02_14_56-15379918687981849165
2023/05/23 09:14:57 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-23_02_14_56-15379918687981849165?project=apache-beam-testing
2023/05/23 09:14:57 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-23_02_14_56-15379918687981849165
2023/05/23 09:14:57 Job state: JOB_STATE_PENDING ...
2023/05/23 09:15:27 Job still running ...
2023/05/23 09:15:57 Job still running ...
2023/05/23 09:16:27 Job still running ...
2023/05/23 09:16:57 Job still running ...
2023/05/23 09:17:27 Job still running ...
2023/05/23 09:17:57 Job still running ...
2023/05/23 09:18:27 Job still running ...
2023/05/23 09:18:57 Job still running ...
2023/05/23 09:19:27 Job still running ...
2023/05/23 09:19:57 Job still running ...
2023/05/23 09:20:27 Job still running ...
2023/05/23 09:20:57 Job still running ...
2023/05/23 09:21:27 Job still running ...
2023/05/23 09:21:57 Job still running ...
2023/05/23 09:22:27 Job still running ...
2023/05/23 09:22:57 Job still running ...
2023/05/23 09:23:27 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-23_02_14_56-15379918687981849165 failed
--- FAIL: TestXLang_Partition (550.38s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3092.554s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684830748589352640
--- FAIL: TestBigQueryIO_BasicWriteRead (4.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39895 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lcrgkWjLKI" is_bounded:BOUNDED windowing_strategy_id:"w0@lcrgkWjLKI"}} windowing_strategies:{key:"w0@lcrgkWjLKI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lcrgkWjLKI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lcrgkWjLKI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lcrgkWjLKI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684830748589352640\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lcrgkWjLKI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39895 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lcrgkWjLKI" is_bounded:BOUNDED windowing_strategy_id:"w0@lcrgkWjLKI"}} windowing_strategies:{key:"w0@lcrgkWjLKI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lcrgkWjLKI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lcrgkWjLKI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lcrgkWjLKI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684830748589352640\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lcrgkWjLKI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc0001307c0})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc0001307c0})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00014e0a0?, 0xc000152000?}, {0x11cb22a, 0x39}, {0xc00015c0c0?, 0x10ca800?, 0x41bcd1?}, {0xc0005a3d60, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00014e020?, 0xc000152000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005a3d60, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc00046a008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005831e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005831e0, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.672s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-083155
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-083155
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0083c7b8c649d73d3ec8097f3b18abba4f317a7e08456790936906f4a2a214e9
Deleted: sha256:ca1a848ad6be21b25fe8f894babdcc98e7af8c863320e694695331a512ae026f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-083155
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0083c7b8c649d73d3ec8097f3b18abba4f317a7e08456790936906f4a2a214e9
Associated tags:
- 20230523-083155
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-083155
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-083155].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0083c7b8c649d73d3ec8097f3b18abba4f317a7e08456790936906f4a2a214e9].
$ rm -rf /tmp/tmp.ProMqpx9H2
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c1a0209ab4a6d51e027bb5f0f995b55dcbe36b925310e0c5ac42cde48cd794bc
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c1a0209ab4a6d51e027bb5f0f995b55dcbe36b925310e0c5ac42cde48cd794bc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c1a0209ab4a6d51e027bb5f0f995b55dcbe36b925310e0c5ac42cde48cd794bc])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c1a0209ab4a6d51e027bb5f0f995b55dcbe36b925310e0c5ac42cde48cd794bc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c1a0209ab4a6d51e027bb5f0f995b55dcbe36b925310e0c5ac42cde48cd794bc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c1a0209ab4a6d51e027bb5f0f995b55dcbe36b925310e0c5ac42cde48cd794bc].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:195012d3b6de830f63e5db4987c1f5b290f7d1ebe85184dc6f46bfbdaa7d3145
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:195012d3b6de830f63e5db4987c1f5b290f7d1ebe85184dc6f46bfbdaa7d3145]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:195012d3b6de830f63e5db4987c1f5b290f7d1ebe85184dc6f46bfbdaa7d3145])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:195012d3b6de830f63e5db4987c1f5b290f7d1ebe85184dc6f46bfbdaa7d3145
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:195012d3b6de830f63e5db4987c1f5b290f7d1ebe85184dc6f46bfbdaa7d3145
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:195012d3b6de830f63e5db4987c1f5b290f7d1ebe85184dc6f46bfbdaa7d3145].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2383852.
Stopping expansion service pid: 2383853.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 44s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/cgdbtzjthrkn4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1668
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1668/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523022039",
"environmentId": "IPPqRFQBvCbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-023135"
}
]
},
"name": "go-testxlang_partition-601",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/23 03:15:35 Submitted job: 2023-05-22_20_15_34-15529608415056424725
2023/05/23 03:15:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-22_20_15_34-15529608415056424725?project=apache-beam-testing
2023/05/23 03:15:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-22_20_15_34-15529608415056424725
2023/05/23 03:15:35 Job state: JOB_STATE_PENDING ...
2023/05/23 03:16:05 Job still running ...
2023/05/23 03:16:35 Job still running ...
2023/05/23 03:17:05 Job still running ...
2023/05/23 03:17:35 Job still running ...
2023/05/23 03:18:05 Job still running ...
2023/05/23 03:18:35 Job still running ...
2023/05/23 03:19:05 Job still running ...
2023/05/23 03:19:35 Job still running ...
2023/05/23 03:20:05 Job still running ...
2023/05/23 03:20:35 Job still running ...
2023/05/23 03:21:05 Job still running ...
2023/05/23 03:21:35 Job still running ...
2023/05/23 03:22:05 Job still running ...
2023/05/23 03:22:35 Job still running ...
2023/05/23 03:23:05 Job still running ...
2023/05/23 03:23:36 Job still running ...
2023/05/23 03:24:06 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-22_20_15_34-15529608415056424725 failed
--- FAIL: TestXLang_Partition (550.64s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3149.932s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684809129871483657
--- FAIL: TestBigQueryIO_BasicWriteRead (4.81s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38841 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aXOMqKYINk" is_bounded:BOUNDED windowing_strategy_id:"w0@aXOMqKYINk"}} windowing_strategies:{key:"w0@aXOMqKYINk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aXOMqKYINk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aXOMqKYINk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aXOMqKYINk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684809129871483657\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aXOMqKYINk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38841 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aXOMqKYINk" is_bounded:BOUNDED windowing_strategy_id:"w0@aXOMqKYINk"}} windowing_strategies:{key:"w0@aXOMqKYINk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aXOMqKYINk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aXOMqKYINk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aXOMqKYINk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684809129871483657\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aXOMqKYINk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000312680})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000312680})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006940c0?, 0xc00065a000?}, {0x11cb22a, 0x39}, {0xc0006640c0?, 0x10ca800?, 0x41bcd1?}, {0xc00046de70, 0xf}, 0xc0001a3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000694040?, 0xc00065a000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc0001a3ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de70, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc000700028})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.836s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-023135
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-023135
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8044d6879a2238647b34f000582525e97eaff897e06184aedb33c3b84f979a47
Deleted: sha256:964ef464c289ac8513b4f79b3a3ac57c9bc03eb9ba13f990c85edd458a546b3e
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-023135
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8044d6879a2238647b34f000582525e97eaff897e06184aedb33c3b84f979a47
Associated tags:
- 20230523-023135
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-023135
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230523-023135].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8044d6879a2238647b34f000582525e97eaff897e06184aedb33c3b84f979a47].
$ rm -rf /tmp/tmp.mc9T1cTNtk
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523022039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:090f229eac54edd1c4388db7482b130da3ff3dc5b1877921db72dca816e45822
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:090f229eac54edd1c4388db7482b130da3ff3dc5b1877921db72dca816e45822]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230523022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:090f229eac54edd1c4388db7482b130da3ff3dc5b1877921db72dca816e45822])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:090f229eac54edd1c4388db7482b130da3ff3dc5b1877921db72dca816e45822
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:090f229eac54edd1c4388db7482b130da3ff3dc5b1877921db72dca816e45822
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:090f229eac54edd1c4388db7482b130da3ff3dc5b1877921db72dca816e45822].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523022039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113016d7eb1e902f59e1ed1d45ab23dee5de78ffb08435ac1d202d8bb37ada6c
Deleted: sha256:a5abca89ef0e162424ef4175094cd2d0115e0f31dbf04b4eec9e7d1a3c5f69f2
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113016d7eb1e902f59e1ed1d45ab23dee5de78ffb08435ac1d202d8bb37ada6c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230523022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113016d7eb1e902f59e1ed1d45ab23dee5de78ffb08435ac1d202d8bb37ada6c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113016d7eb1e902f59e1ed1d45ab23dee5de78ffb08435ac1d202d8bb37ada6c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113016d7eb1e902f59e1ed1d45ab23dee5de78ffb08435ac1d202d8bb37ada6c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113016d7eb1e902f59e1ed1d45ab23dee5de78ffb08435ac1d202d8bb37ada6c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1875954.
Stopping expansion service pid: 1875955.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 27s
232 actionable tasks: 154 executed, 66 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/5ltmjsle2lz3o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1667
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1667/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522202027",
"environmentId": "WegZATruaRbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-203108"
}
]
},
"name": "go-testxlang_partition-845",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/22 21:13:37 Submitted job: 2023-05-22_14_13_36-10872794839852519557
2023/05/22 21:13:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-22_14_13_36-10872794839852519557?project=apache-beam-testing
2023/05/22 21:13:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-22_14_13_36-10872794839852519557
2023/05/22 21:13:37 Job state: JOB_STATE_PENDING ...
2023/05/22 21:14:07 Job still running ...
2023/05/22 21:14:37 Job still running ...
2023/05/22 21:15:07 Job still running ...
2023/05/22 21:15:37 Job still running ...
2023/05/22 21:16:07 Job still running ...
2023/05/22 21:16:37 Job still running ...
2023/05/22 21:17:07 Job still running ...
2023/05/22 21:17:37 Job still running ...
2023/05/22 21:18:07 Job still running ...
2023/05/22 21:18:37 Job still running ...
2023/05/22 21:19:07 Job still running ...
2023/05/22 21:19:37 Job still running ...
2023/05/22 21:20:07 Job still running ...
2023/05/22 21:20:37 Job still running ...
2023/05/22 21:21:07 Job still running ...
2023/05/22 21:21:37 Job still running ...
2023/05/22 21:22:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-22_14_13_36-10872794839852519557 failed
--- FAIL: TestXLang_Partition (550.17s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3058.106s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684787506803317304
--- FAIL: TestBigQueryIO_BasicWriteRead (4.36s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36967 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ygPLKIqOLD" is_bounded:BOUNDED windowing_strategy_id:"w0@ygPLKIqOLD"}} windowing_strategies:{key:"w0@ygPLKIqOLD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ygPLKIqOLD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ygPLKIqOLD" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ygPLKIqOLD" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684787506803317304\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ygPLKIqOLD"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36967 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ygPLKIqOLD" is_bounded:BOUNDED windowing_strategy_id:"w0@ygPLKIqOLD"}} windowing_strategies:{key:"w0@ygPLKIqOLD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ygPLKIqOLD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ygPLKIqOLD" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ygPLKIqOLD" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684787506803317304\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ygPLKIqOLD"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc00021e680})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc00021e680})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0007200e0?, 0xc00012c000?}, {0x11cb22a, 0x39}, {0xc0001380c0?, 0x10ca800?, 0x41bcd1?}, {0xc0006dbd60, 0xf}, 0xc000577d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000720060?, 0xc00012c000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc000577ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0006dbd60, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc000710088})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583d40, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.389s
=== RUN TestDebeziumIO_BasicRead
integration.go:318: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:318: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:318: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:318: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-203108
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-203108
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:71d686c5e0105c47ea1c1d8a64cd1e32a96bdf8736be603f002d48e79626f2ef
Deleted: sha256:f87c85b688f6f94b7038cfbf7eeb70745d7af839db73d3203a8c68fa4689d733
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-203108
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:71d686c5e0105c47ea1c1d8a64cd1e32a96bdf8736be603f002d48e79626f2ef
Associated tags:
- 20230522-203108
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-203108
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-203108].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:71d686c5e0105c47ea1c1d8a64cd1e32a96bdf8736be603f002d48e79626f2ef].
$ rm -rf /tmp/tmp.qIAPueew4S
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522202027
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2ac37fce45b1e35868cde15a7ac3fe61a13a9a3ba6558a64c74a7dbbab14243e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522202027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2ac37fce45b1e35868cde15a7ac3fe61a13a9a3ba6558a64c74a7dbbab14243e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522202027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2ac37fce45b1e35868cde15a7ac3fe61a13a9a3ba6558a64c74a7dbbab14243e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2ac37fce45b1e35868cde15a7ac3fe61a13a9a3ba6558a64c74a7dbbab14243e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2ac37fce45b1e35868cde15a7ac3fe61a13a9a3ba6558a64c74a7dbbab14243e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2ac37fce45b1e35868cde15a7ac3fe61a13a9a3ba6558a64c74a7dbbab14243e].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522202027
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9595da4c7022ce5cb923e2cf7e9a6c06b05f8bdb78f49dcb7dc12cb41e324c1
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522202027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9595da4c7022ce5cb923e2cf7e9a6c06b05f8bdb78f49dcb7dc12cb41e324c1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522202027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9595da4c7022ce5cb923e2cf7e9a6c06b05f8bdb78f49dcb7dc12cb41e324c1])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9595da4c7022ce5cb923e2cf7e9a6c06b05f8bdb78f49dcb7dc12cb41e324c1
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9595da4c7022ce5cb923e2cf7e9a6c06b05f8bdb78f49dcb7dc12cb41e324c1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9595da4c7022ce5cb923e2cf7e9a6c06b05f8bdb78f49dcb7dc12cb41e324c1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1616669.
Stopping expansion service pid: 1616670.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 37s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/kd72sraneeyy6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1666
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1666/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-143127",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-143127"
}
]
},
"name": "go-testxlang_partition-337",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/22 15:15:31 Submitted job: 2023-05-22_08_15_28-7476554086235399541
2023/05/22 15:15:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-22_08_15_28-7476554086235399541?project=apache-beam-testing
2023/05/22 15:15:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-22_08_15_28-7476554086235399541
2023/05/22 15:15:31 Job state: JOB_STATE_PENDING ...
2023/05/22 15:16:01 Job still running ...
2023/05/22 15:16:31 Job still running ...
2023/05/22 15:17:01 Job still running ...
2023/05/22 15:17:31 Job still running ...
2023/05/22 15:18:01 Job still running ...
2023/05/22 15:18:31 Job still running ...
2023/05/22 15:19:01 Job still running ...
2023/05/22 15:19:31 Job still running ...
2023/05/22 15:20:01 Job still running ...
2023/05/22 15:20:31 Job still running ...
2023/05/22 15:21:01 Job still running ...
2023/05/22 15:21:31 Job still running ...
2023/05/22 15:22:01 Job still running ...
2023/05/22 15:22:31 Job still running ...
2023/05/22 15:23:01 Job still running ...
2023/05/22 15:23:31 Job still running ...
2023/05/22 15:24:01 Job still running ...
2023/05/22 15:24:31 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-22_08_15_28-7476554086235399541 failed
--- FAIL: TestXLang_Partition (582.35s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3184.472s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684765920683257040
--- FAIL: TestBigQueryIO_BasicWriteRead (4.40s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38413 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jWplMQPira" is_bounded:BOUNDED windowing_strategy_id:"w0@jWplMQPira"}} windowing_strategies:{key:"w0@jWplMQPira" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jWplMQPira" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jWplMQPira" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jWplMQPira" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684765920683257040\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jWplMQPira"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38413 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jWplMQPira" is_bounded:BOUNDED windowing_strategy_id:"w0@jWplMQPira"}} windowing_strategies:{key:"w0@jWplMQPira" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jWplMQPira" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jWplMQPira" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jWplMQPira" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684765920683257040\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jWplMQPira"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000206680})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000206680})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aa1e0?, 0xc0000c0280?}, {0x11cb21b, 0x39}, {0xc0006220c0?, 0x10ca800?, 0x41bcd1?}, {0xc00046de10, 0xf}, 0xc000571d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aa040?, 0xc0000c0280?}, {0xc000050f00, 0x52}, {0x1?}, {0xc000571ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001031e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001031e0, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.428s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-143127
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-143127
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8f66c6a5b1f93bfc87ef7157614acd5d83d7e552b3263c44f4170ebf01bc621f
Deleted: sha256:1d4153a7a91f6e90985427cb5656f39f95a9992e39f555de8995ac37aeb83985
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-143127
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8f66c6a5b1f93bfc87ef7157614acd5d83d7e552b3263c44f4170ebf01bc621f
Associated tags:
- 20230522-143127
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-143127
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-143127].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8f66c6a5b1f93bfc87ef7157614acd5d83d7e552b3263c44f4170ebf01bc621f].
$ rm -rf /tmp/tmp.Sh2VGGEuHw
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522142039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:58d33b51d1a9b38b6c6505463c7cca4383671015331dd625b6548ca456b5aafc
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:58d33b51d1a9b38b6c6505463c7cca4383671015331dd625b6548ca456b5aafc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:58d33b51d1a9b38b6c6505463c7cca4383671015331dd625b6548ca456b5aafc])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:58d33b51d1a9b38b6c6505463c7cca4383671015331dd625b6548ca456b5aafc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:58d33b51d1a9b38b6c6505463c7cca4383671015331dd625b6548ca456b5aafc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:58d33b51d1a9b38b6c6505463c7cca4383671015331dd625b6548ca456b5aafc].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522142039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe96feda7d5f853ef8bb953f53339c0432412c404a089e21001d9e807e722e3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe96feda7d5f853ef8bb953f53339c0432412c404a089e21001d9e807e722e3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe96feda7d5f853ef8bb953f53339c0432412c404a089e21001d9e807e722e3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe96feda7d5f853ef8bb953f53339c0432412c404a089e21001d9e807e722e3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe96feda7d5f853ef8bb953f53339c0432412c404a089e21001d9e807e722e3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cbe96feda7d5f853ef8bb953f53339c0432412c404a089e21001d9e807e722e3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1514618.
Stopping expansion service pid: 1514619.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 49s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/enx2o2p3t5ugi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1665
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1665/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522082040",
"environmentId": "tsHpMmuIegbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-083124"
}
]
},
"name": "go-testxlang_partition-403",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/22 09:14:31 Submitted job: 2023-05-22_02_14_31-7019227399294608091
2023/05/22 09:14:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-22_02_14_31-7019227399294608091?project=apache-beam-testing
2023/05/22 09:14:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-22_02_14_31-7019227399294608091
2023/05/22 09:14:31 Job state: JOB_STATE_PENDING ...
2023/05/22 09:15:01 Job still running ...
2023/05/22 09:15:31 Job still running ...
2023/05/22 09:16:01 Job still running ...
2023/05/22 09:16:31 Job still running ...
2023/05/22 09:17:02 Job still running ...
2023/05/22 09:17:32 Job still running ...
2023/05/22 09:18:02 Job still running ...
2023/05/22 09:18:32 Job still running ...
2023/05/22 09:19:02 Job still running ...
2023/05/22 09:19:32 Job still running ...
2023/05/22 09:20:02 Job still running ...
2023/05/22 09:20:32 Job still running ...
2023/05/22 09:21:02 Job still running ...
2023/05/22 09:21:32 Job still running ...
2023/05/22 09:22:02 Job still running ...
2023/05/22 09:22:32 Job still running ...
2023/05/22 09:23:02 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-22_02_14_31-7019227399294608091 failed
--- FAIL: TestXLang_Partition (550.23s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3097.336s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684744319051063003
--- FAIL: TestBigQueryIO_BasicWriteRead (5.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37775 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vmiKkMAJVJ" is_bounded:BOUNDED windowing_strategy_id:"w0@vmiKkMAJVJ"}} windowing_strategies:{key:"w0@vmiKkMAJVJ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vmiKkMAJVJ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vmiKkMAJVJ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vmiKkMAJVJ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684744319051063003\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vmiKkMAJVJ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37775 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vmiKkMAJVJ" is_bounded:BOUNDED windowing_strategy_id:"w0@vmiKkMAJVJ"}} windowing_strategies:{key:"w0@vmiKkMAJVJ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vmiKkMAJVJ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vmiKkMAJVJ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vmiKkMAJVJ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684744319051063003\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vmiKkMAJVJ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc0004f0e40})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc0004f0e40})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006560a0?, 0xc000658000?}, {0x11cb21b, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000045ef0, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000656020?, 0xc000658000?}, {0xc000050960, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045ef0, 0xf}, {0xc000050960, 0x52}, {0xf26ee0, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.676s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-083124
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-083124
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:07f396b407e0ad335cee48d4589426d7944679bf561608fcf8cb8a67d64605fe
Deleted: sha256:1153ac702b61869a0dd0d3213c9ed2f032b20351fca18b4f71e2148141f032fb
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-083124
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:07f396b407e0ad335cee48d4589426d7944679bf561608fcf8cb8a67d64605fe
Associated tags:
- 20230522-083124
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-083124
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-083124].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:07f396b407e0ad335cee48d4589426d7944679bf561608fcf8cb8a67d64605fe].
$ rm -rf /tmp/tmp.uYgbuXDTIz
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1e0d16040733934ad6a503732a6eb33a8f306fdf478df6b723c8e39fc75e70b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1e0d16040733934ad6a503732a6eb33a8f306fdf478df6b723c8e39fc75e70b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1e0d16040733934ad6a503732a6eb33a8f306fdf478df6b723c8e39fc75e70b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1e0d16040733934ad6a503732a6eb33a8f306fdf478df6b723c8e39fc75e70b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1e0d16040733934ad6a503732a6eb33a8f306fdf478df6b723c8e39fc75e70b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1e0d16040733934ad6a503732a6eb33a8f306fdf478df6b723c8e39fc75e70b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7689f6d8082345716b37435ea2f2113e394aaf647cbae6072f7b1c04a0a3f449
Deleted: sha256:ebbaf0572110621caa525f1189e55ca6541e926733d9ddad6bfa6d36be173a43
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7689f6d8082345716b37435ea2f2113e394aaf647cbae6072f7b1c04a0a3f449]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7689f6d8082345716b37435ea2f2113e394aaf647cbae6072f7b1c04a0a3f449])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7689f6d8082345716b37435ea2f2113e394aaf647cbae6072f7b1c04a0a3f449
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7689f6d8082345716b37435ea2f2113e394aaf647cbae6072f7b1c04a0a3f449
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7689f6d8082345716b37435ea2f2113e394aaf647cbae6072f7b1c04a0a3f449].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 984366.
Stopping expansion service pid: 984367.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 19s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/l7rkjatgb5lr2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1664
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1664/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522022040",
"environmentId": "NaTQCiTbwtbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-023131"
}
]
},
"name": "go-testxlang_partition-76",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/22 03:13:54 Submitted job: 2023-05-21_20_13_53-18344757554409808505
2023/05/22 03:13:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-21_20_13_53-18344757554409808505?project=apache-beam-testing
2023/05/22 03:13:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-21_20_13_53-18344757554409808505
2023/05/22 03:13:54 Job state: JOB_STATE_PENDING ...
2023/05/22 03:14:24 Job still running ...
2023/05/22 03:14:54 Job still running ...
2023/05/22 03:15:24 Job still running ...
2023/05/22 03:15:54 Job still running ...
2023/05/22 03:16:24 Job still running ...
2023/05/22 03:16:54 Job still running ...
2023/05/22 03:17:24 Job still running ...
2023/05/22 03:17:54 Job still running ...
2023/05/22 03:18:24 Job still running ...
2023/05/22 03:18:54 Job still running ...
2023/05/22 03:19:24 Job still running ...
2023/05/22 03:19:54 Job still running ...
2023/05/22 03:20:24 Job still running ...
2023/05/22 03:20:54 Job still running ...
2023/05/22 03:21:24 Job still running ...
2023/05/22 03:21:54 Job still running ...
2023/05/22 03:22:25 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-21_20_13_53-18344757554409808505 failed
--- FAIL: TestXLang_Partition (549.85s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3054.159s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684722724272294353
--- FAIL: TestBigQueryIO_BasicWriteRead (4.56s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35827 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WaUawABmxc" is_bounded:BOUNDED windowing_strategy_id:"w0@WaUawABmxc"}} windowing_strategies:{key:"w0@WaUawABmxc" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WaUawABmxc" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WaUawABmxc" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WaUawABmxc" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684722724272294353\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WaUawABmxc"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35827 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WaUawABmxc" is_bounded:BOUNDED windowing_strategy_id:"w0@WaUawABmxc"}} windowing_strategies:{key:"w0@WaUawABmxc" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WaUawABmxc" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WaUawABmxc" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WaUawABmxc" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684722724272294353\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WaUawABmxc"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000322700})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000322700})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006aa0e0?, 0xc0006ae050?}, {0x11cb21b, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000045f10, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006aa060?, 0xc0006ae050?}, {0xc000050a20, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f10, 0xf}, {0xc000050a20, 0x52}, {0xf26ee0, 0xc00068c038})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000d7380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000d7380, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.583s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-023131
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-023131
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c871f6caaf76a544ffc214c9620bb2cc07de596073ede88b0c3923ca7a0202e3
Deleted: sha256:c0d3ffce6bb27f2edabd40d43e6a3a1ca040d549b82bb73d81281c44b8165f12
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-023131
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c871f6caaf76a544ffc214c9620bb2cc07de596073ede88b0c3923ca7a0202e3
Associated tags:
- 20230522-023131
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-023131
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230522-023131].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c871f6caaf76a544ffc214c9620bb2cc07de596073ede88b0c3923ca7a0202e3].
$ rm -rf /tmp/tmp.4IFtNfbxcM
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:16c4407b5a4d00caf74ba4552ff39a624536ab069570cf471c94a27e81e67ad4
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:16c4407b5a4d00caf74ba4552ff39a624536ab069570cf471c94a27e81e67ad4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230522022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:16c4407b5a4d00caf74ba4552ff39a624536ab069570cf471c94a27e81e67ad4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:16c4407b5a4d00caf74ba4552ff39a624536ab069570cf471c94a27e81e67ad4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:16c4407b5a4d00caf74ba4552ff39a624536ab069570cf471c94a27e81e67ad4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:16c4407b5a4d00caf74ba4552ff39a624536ab069570cf471c94a27e81e67ad4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8cc542ccec461eac1f10220dadb490c07771d67091a99cb4b99d055531143a67
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8cc542ccec461eac1f10220dadb490c07771d67091a99cb4b99d055531143a67]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230522022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8cc542ccec461eac1f10220dadb490c07771d67091a99cb4b99d055531143a67])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8cc542ccec461eac1f10220dadb490c07771d67091a99cb4b99d055531143a67
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8cc542ccec461eac1f10220dadb490c07771d67091a99cb4b99d055531143a67
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8cc542ccec461eac1f10220dadb490c07771d67091a99cb4b99d055531143a67].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 498263.
Stopping expansion service pid: 498264.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 41s
232 actionable tasks: 153 executed, 67 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/724pdmz2qmuzs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1663
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1663/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521202044",
"environmentId": "htGtvQuXIcbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-203145"
}
]
},
"name": "go-testxlang_partition-548",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/21 21:14:42 Submitted job: 2023-05-21_14_14_42-7104232053791156184
2023/05/21 21:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-21_14_14_42-7104232053791156184?project=apache-beam-testing
2023/05/21 21:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-21_14_14_42-7104232053791156184
2023/05/21 21:14:42 Job state: JOB_STATE_PENDING ...
2023/05/21 21:15:12 Job still running ...
2023/05/21 21:15:42 Job still running ...
2023/05/21 21:16:13 Job still running ...
2023/05/21 21:16:43 Job still running ...
2023/05/21 21:17:13 Job still running ...
2023/05/21 21:17:43 Job still running ...
2023/05/21 21:18:13 Job still running ...
2023/05/21 21:18:43 Job still running ...
2023/05/21 21:19:13 Job still running ...
2023/05/21 21:19:43 Job still running ...
2023/05/21 21:20:13 Job still running ...
2023/05/21 21:20:43 Job still running ...
2023/05/21 21:21:13 Job still running ...
2023/05/21 21:21:43 Job still running ...
2023/05/21 21:22:13 Job still running ...
2023/05/21 21:22:43 Job still running ...
2023/05/21 21:23:13 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-21_14_14_42-7104232053791156184 failed
--- FAIL: TestXLang_Partition (550.07s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3085.809s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684701140884864925
--- FAIL: TestBigQueryIO_BasicWriteRead (4.64s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43461 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@VUjUTauWYd" is_bounded:BOUNDED windowing_strategy_id:"w0@VUjUTauWYd"}} windowing_strategies:{key:"w0@VUjUTauWYd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@VUjUTauWYd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@VUjUTauWYd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@VUjUTauWYd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684701140884864925\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"VUjUTauWYd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43461 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@VUjUTauWYd" is_bounded:BOUNDED windowing_strategy_id:"w0@VUjUTauWYd"}} windowing_strategies:{key:"w0@VUjUTauWYd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@VUjUTauWYd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@VUjUTauWYd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@VUjUTauWYd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684701140884864925\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"VUjUTauWYd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000280680})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000280680})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000788140?, 0xc00014a000?}, {0x11cb21b, 0x39}, {0xc0000f4180?, 0x10ca800?, 0x41bcd1?}, {0xc00046dc40, 0xf}, 0xc00056fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0007880c0?, 0xc00014a000?}, {0xc000050d20, 0x52}, {0x1?}, {0xc00056fea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dc40, 0xf}, {0xc000050d20, 0x52}, {0xf26ee0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000702b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000702b60, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.665s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-203145
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-203145
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2845e921f194d2eb7c3c693427ffcb5483c457c8bff0a281eff527a36a867c6a
Deleted: sha256:4c7df9cdbe114b9ba02121479b671e19e4bf673aff9e8581fa4610d64f5d6894
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-203145
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2845e921f194d2eb7c3c693427ffcb5483c457c8bff0a281eff527a36a867c6a
Associated tags:
- 20230521-203145
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-203145
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-203145].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2845e921f194d2eb7c3c693427ffcb5483c457c8bff0a281eff527a36a867c6a].
$ rm -rf /tmp/tmp.RJagsIGsTx
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521202044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fff317b5595a8850e13779c6c28aa2587ceb8801896ac50e5bcc430d0b78de7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521202044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fff317b5595a8850e13779c6c28aa2587ceb8801896ac50e5bcc430d0b78de7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521202044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fff317b5595a8850e13779c6c28aa2587ceb8801896ac50e5bcc430d0b78de7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fff317b5595a8850e13779c6c28aa2587ceb8801896ac50e5bcc430d0b78de7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fff317b5595a8850e13779c6c28aa2587ceb8801896ac50e5bcc430d0b78de7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fff317b5595a8850e13779c6c28aa2587ceb8801896ac50e5bcc430d0b78de7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521202044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b72e0249f5b3d9b229859a993240df3547bfcd1c6ba5938e25022b4e009286
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521202044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b72e0249f5b3d9b229859a993240df3547bfcd1c6ba5938e25022b4e009286]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521202044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b72e0249f5b3d9b229859a993240df3547bfcd1c6ba5938e25022b4e009286])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b72e0249f5b3d9b229859a993240df3547bfcd1c6ba5938e25022b4e009286
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b72e0249f5b3d9b229859a993240df3547bfcd1c6ba5938e25022b4e009286
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b72e0249f5b3d9b229859a993240df3547bfcd1c6ba5938e25022b4e009286].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 379519.
Stopping expansion service pid: 379520.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 29s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/3gjkjmdexjb4w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1662
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1662/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521142027",
"environmentId": "JWEtDQRajrbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-143054"
}
]
},
"name": "go-testxlang_partition-327",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/21 15:12:46 Submitted job: 2023-05-21_08_12_46-13585088818346710107
2023/05/21 15:12:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-21_08_12_46-13585088818346710107?project=apache-beam-testing
2023/05/21 15:12:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-21_08_12_46-13585088818346710107
2023/05/21 15:12:46 Job state: JOB_STATE_PENDING ...
2023/05/21 15:13:16 Job still running ...
2023/05/21 15:13:46 Job still running ...
2023/05/21 15:14:16 Job still running ...
2023/05/21 15:14:47 Job still running ...
2023/05/21 15:15:17 Job still running ...
2023/05/21 15:15:47 Job still running ...
2023/05/21 15:16:17 Job still running ...
2023/05/21 15:16:47 Job still running ...
2023/05/21 15:17:17 Job still running ...
2023/05/21 15:17:47 Job still running ...
2023/05/21 15:18:17 Job still running ...
2023/05/21 15:18:47 Job still running ...
2023/05/21 15:19:17 Job still running ...
2023/05/21 15:19:47 Job still running ...
2023/05/21 15:20:17 Job still running ...
2023/05/21 15:20:47 Job still running ...
2023/05/21 15:21:17 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-21_08_12_46-13585088818346710107 failed
--- FAIL: TestXLang_Partition (550.43s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3024.128s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684679486634572001
--- FAIL: TestBigQueryIO_BasicWriteRead (4.32s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34841 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XoGhEbOVCK" is_bounded:BOUNDED windowing_strategy_id:"w0@XoGhEbOVCK"}} windowing_strategies:{key:"w0@XoGhEbOVCK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XoGhEbOVCK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XoGhEbOVCK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XoGhEbOVCK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684679486634572001\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XoGhEbOVCK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34841 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XoGhEbOVCK" is_bounded:BOUNDED windowing_strategy_id:"w0@XoGhEbOVCK"}} windowing_strategies:{key:"w0@XoGhEbOVCK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XoGhEbOVCK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XoGhEbOVCK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XoGhEbOVCK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684679486634572001\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XoGhEbOVCK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc000672940})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc000672940})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004fc0a0?, 0xc0000c0050?}, {0x11cb21b, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000489f80, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004fc020?, 0xc0000c0050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010ec00, 0x52}, {0xf26ee0, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000351860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000351860, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.352s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-143054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-143054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7be78f1d4d4e8b5e9c293654c170d3cc21737baa57d7faf253d06ae89c05a0d0
Deleted: sha256:0cf78d540f594f38cb2724a5423b040a3f1be7c3591f0127a88c3531c01734ea
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-143054
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7be78f1d4d4e8b5e9c293654c170d3cc21737baa57d7faf253d06ae89c05a0d0
Associated tags:
- 20230521-143054
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-143054
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-143054].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7be78f1d4d4e8b5e9c293654c170d3cc21737baa57d7faf253d06ae89c05a0d0].
$ rm -rf /tmp/tmp.K1an3g6JbK
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521142027
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c777a554f31f6a5befc8640147d43c5a40f50f113b968c62719a672a47da25c7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521142027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c777a554f31f6a5befc8640147d43c5a40f50f113b968c62719a672a47da25c7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521142027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c777a554f31f6a5befc8640147d43c5a40f50f113b968c62719a672a47da25c7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c777a554f31f6a5befc8640147d43c5a40f50f113b968c62719a672a47da25c7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c777a554f31f6a5befc8640147d43c5a40f50f113b968c62719a672a47da25c7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c777a554f31f6a5befc8640147d43c5a40f50f113b968c62719a672a47da25c7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521142027
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077271fcde24a49bab622a2a7669438bfd246d4b01718ae3cfcf3848a8dea2f8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521142027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077271fcde24a49bab622a2a7669438bfd246d4b01718ae3cfcf3848a8dea2f8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521142027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077271fcde24a49bab622a2a7669438bfd246d4b01718ae3cfcf3848a8dea2f8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077271fcde24a49bab622a2a7669438bfd246d4b01718ae3cfcf3848a8dea2f8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077271fcde24a49bab622a2a7669438bfd246d4b01718ae3cfcf3848a8dea2f8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077271fcde24a49bab622a2a7669438bfd246d4b01718ae3cfcf3848a8dea2f8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 277449.
Stopping expansion service pid: 277450.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 1m 46s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/pab5smj3nkwnu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1661
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1661/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-083223",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521082038",
"environmentId": "KGaABYJtMqbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-083223"
}
]
},
"name": "go-testxlang_partition-792",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/21 09:15:02 Submitted job: 2023-05-21_02_15_01-10245036074105398593
2023/05/21 09:15:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-21_02_15_01-10245036074105398593?project=apache-beam-testing
2023/05/21 09:15:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-21_02_15_01-10245036074105398593
2023/05/21 09:15:02 Job state: JOB_STATE_PENDING ...
2023/05/21 09:15:32 Job still running ...
2023/05/21 09:16:02 Job still running ...
2023/05/21 09:16:32 Job still running ...
2023/05/21 09:17:02 Job still running ...
2023/05/21 09:17:32 Job still running ...
2023/05/21 09:18:02 Job still running ...
2023/05/21 09:18:32 Job still running ...
2023/05/21 09:19:02 Job still running ...
2023/05/21 09:19:32 Job still running ...
2023/05/21 09:20:02 Job still running ...
2023/05/21 09:20:32 Job still running ...
2023/05/21 09:21:02 Job still running ...
2023/05/21 09:21:32 Job still running ...
2023/05/21 09:22:03 Job still running ...
2023/05/21 09:22:33 Job still running ...
2023/05/21 09:23:03 Job still running ...
2023/05/21 09:23:33 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-21_02_15_01-10245036074105398593 failed
--- FAIL: TestXLang_Partition (550.80s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3057.251s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684657989198597774
--- FAIL: TestBigQueryIO_BasicWriteRead (5.24s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42047 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@crCtUOEtSR" is_bounded:BOUNDED windowing_strategy_id:"w0@crCtUOEtSR"}} windowing_strategies:{key:"w0@crCtUOEtSR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@crCtUOEtSR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@crCtUOEtSR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@crCtUOEtSR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684657989198597774\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"crCtUOEtSR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42047 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@crCtUOEtSR" is_bounded:BOUNDED windowing_strategy_id:"w0@crCtUOEtSR"}} windowing_strategies:{key:"w0@crCtUOEtSR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@crCtUOEtSR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@crCtUOEtSR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@crCtUOEtSR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684657989198597774\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"crCtUOEtSR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc0000b4b80})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc0000b4b80})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003d80a0?, 0xc0003da000?}, {0x11cb21b, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000487f80, 0xf}, 0xc0002d3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003d8020?, 0xc0003da000?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc0002d3ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000487f80, 0xf}, {0xc00010ec00, 0x52}, {0xf26ee0, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00034fba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00034fba0, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.276s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.038s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.037s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fac1d52011af865aa704358bde0f99cd1cb08c9eb037459908bad0824000c7d6
Associated tags:
- 20230521-083223
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-083223
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-083223].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fac1d52011af865aa704358bde0f99cd1cb08c9eb037459908bad0824000c7d6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a9b5707a3a18ffa1cd86c329f13afab6497d03229613f547f8f1fa4bf266f55]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a9b5707a3a18ffa1cd86c329f13afab6497d03229613f547f8f1fa4bf266f55])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a9b5707a3a18ffa1cd86c329f13afab6497d03229613f547f8f1fa4bf266f55
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a9b5707a3a18ffa1cd86c329f13afab6497d03229613f547f8f1fa4bf266f55].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dab45ba3cc83b5c9abcdebfbab116c5a9fad3e711e39781b58ebbed0ae87bd7e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dab45ba3cc83b5c9abcdebfbab116c5a9fad3e711e39781b58ebbed0ae87bd7e])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dab45ba3cc83b5c9abcdebfbab116c5a9fad3e711e39781b58ebbed0ae87bd7e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dab45ba3cc83b5c9abcdebfbab116c5a9fad3e711e39781b58ebbed0ae87bd7e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 50s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/r4ipg3bhzvyfa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1660
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1660/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-023053",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521022027",
"environmentId": "PktlPApBBfbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-023053"
}
]
},
"name": "go-testxlang_partition-299",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/21 03:13:19 Submitted job: 2023-05-20_20_13_18-5126290009175112085
2023/05/21 03:13:19 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-20_20_13_18-5126290009175112085?project=apache-beam-testing
2023/05/21 03:13:19 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-20_20_13_18-5126290009175112085
2023/05/21 03:13:19 Job state: JOB_STATE_PENDING ...
2023/05/21 03:13:49 Job still running ...
2023/05/21 03:14:19 Job still running ...
2023/05/21 03:14:49 Job still running ...
2023/05/21 03:15:19 Job still running ...
2023/05/21 03:15:49 Job still running ...
2023/05/21 03:16:19 Job still running ...
2023/05/21 03:16:49 Job still running ...
2023/05/21 03:17:19 Job still running ...
2023/05/21 03:17:49 Job still running ...
2023/05/21 03:18:19 Job still running ...
2023/05/21 03:18:49 Job still running ...
2023/05/21 03:19:19 Job still running ...
2023/05/21 03:19:49 Job still running ...
2023/05/21 03:20:19 Job still running ...
2023/05/21 03:20:49 Job still running ...
2023/05/21 03:21:19 Job still running ...
2023/05/21 03:21:49 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-20_20_13_18-5126290009175112085 failed
--- FAIL: TestXLang_Partition (550.72s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3055.011s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684636288055147038
--- FAIL: TestBigQueryIO_BasicWriteRead (4.43s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35875 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FIELHTGqrF" is_bounded:BOUNDED windowing_strategy_id:"w0@FIELHTGqrF"}} windowing_strategies:{key:"w0@FIELHTGqrF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FIELHTGqrF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FIELHTGqrF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FIELHTGqrF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684636288055147038\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FIELHTGqrF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35875 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FIELHTGqrF" is_bounded:BOUNDED windowing_strategy_id:"w0@FIELHTGqrF"}} windowing_strategies:{key:"w0@FIELHTGqrF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FIELHTGqrF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FIELHTGqrF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FIELHTGqrF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684636288055147038\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FIELHTGqrF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc00027e880})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc00027e880})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004fe0a0?, 0xc0000c0050?}, {0x11cb21b, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000487f80, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004fe020?, 0xc0000c0050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000487f80, 0xf}, {0xc00010ec00, 0x52}, {0xf26ee0, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000351a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000351a00, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.460s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b14b02d7465c4ae519f2704c9199991cc5aff322b75ad3d5ef210f4c521392f9
Associated tags:
- 20230521-023053
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-023053
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230521-023053].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b14b02d7465c4ae519f2704c9199991cc5aff322b75ad3d5ef210f4c521392f9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521022027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e9340e475c252309bf3401ba7c3af731d0f45b0f47e7b007aadc770e1509bc79]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230521022027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e9340e475c252309bf3401ba7c3af731d0f45b0f47e7b007aadc770e1509bc79])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e9340e475c252309bf3401ba7c3af731d0f45b0f47e7b007aadc770e1509bc79
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e9340e475c252309bf3401ba7c3af731d0f45b0f47e7b007aadc770e1509bc79].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521022027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af6ae2238c8b52ed53526d1c0c8a92685d88cde7e787bec26bdbe1fd4a445529]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230521022027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af6ae2238c8b52ed53526d1c0c8a92685d88cde7e787bec26bdbe1fd4a445529])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af6ae2238c8b52ed53526d1c0c8a92685d88cde7e787bec26bdbe1fd4a445529
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af6ae2238c8b52ed53526d1c0c8a92685d88cde7e787bec26bdbe1fd4a445529].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 18s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/twe6zkvh7ofn2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1659
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1659/display/redirect?page=changes>
Changes:
[noreply] Close the iframe tag (#26804) (#26805)
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-203128",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520202040",
"environmentId": "GsJSDsEYmLbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-203128"
}
]
},
"name": "go-testxlang_partition-535",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/20 21:11:53 Submitted job: 2023-05-20_14_11_53-15927096546540378580
2023/05/20 21:11:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-20_14_11_53-15927096546540378580?project=apache-beam-testing
2023/05/20 21:11:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-20_14_11_53-15927096546540378580
2023/05/20 21:11:53 Job state: JOB_STATE_PENDING ...
2023/05/20 21:12:23 Job still running ...
2023/05/20 21:12:53 Job still running ...
2023/05/20 21:13:23 Job still running ...
2023/05/20 21:13:53 Job still running ...
2023/05/20 21:14:24 Job still running ...
2023/05/20 21:14:54 Job still running ...
2023/05/20 21:15:24 Job still running ...
2023/05/20 21:15:54 Job still running ...
2023/05/20 21:16:24 Job still running ...
2023/05/20 21:16:54 Job still running ...
2023/05/20 21:17:24 Job still running ...
2023/05/20 21:17:54 Job still running ...
2023/05/20 21:18:24 Job still running ...
2023/05/20 21:18:54 Job still running ...
2023/05/20 21:19:24 Job still running ...
2023/05/20 21:19:54 Job still running ...
2023/05/20 21:20:24 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-20_14_11_53-15927096546540378580 failed
--- FAIL: TestXLang_Partition (549.88s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2934.336s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684614723527185274
--- FAIL: TestBigQueryIO_BasicWriteRead (4.49s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33905 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@BqgtpUBOwd" is_bounded:BOUNDED windowing_strategy_id:"w0@BqgtpUBOwd"}} windowing_strategies:{key:"w0@BqgtpUBOwd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@BqgtpUBOwd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@BqgtpUBOwd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@BqgtpUBOwd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684614723527185274\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"BqgtpUBOwd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33905 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@BqgtpUBOwd" is_bounded:BOUNDED windowing_strategy_id:"w0@BqgtpUBOwd"}} windowing_strategies:{key:"w0@BqgtpUBOwd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@BqgtpUBOwd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@BqgtpUBOwd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@BqgtpUBOwd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684614723527185274\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"BqgtpUBOwd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 43 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc0002827c0})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc0002827c0})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000700f00?, 0xc00071a3c0?}, {0x11cb21b, 0x39}, {0xc0000f4180?, 0x10ca800?, 0x1?}, {0xc00046dca0, 0xf}, 0xc00017dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000700e80?, 0xc00071a3c0?}, {0xc000050d20, 0x52}, {0x1?}, {0xc00017dea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dca0, 0xf}, {0xc000050d20, 0x52}, {0xf26ee0, 0xc00071d210})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d9380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d9380, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.516s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:447898b683fda6298b500a70e19466e095a1090478c0246203ee622fee56952d
Associated tags:
- 20230520-203128
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-203128
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-203128].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:447898b683fda6298b500a70e19466e095a1090478c0246203ee622fee56952d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af3cca44dafa9702f6abc31a21c2a93e371255caa8170a279a88c0d8b493ef81]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af3cca44dafa9702f6abc31a21c2a93e371255caa8170a279a88c0d8b493ef81])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af3cca44dafa9702f6abc31a21c2a93e371255caa8170a279a88c0d8b493ef81
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af3cca44dafa9702f6abc31a21c2a93e371255caa8170a279a88c0d8b493ef81].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6ec0eed2731c035b69ef271817eb7cab90f6d4302edde57dd41a1db9554f987]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6ec0eed2731c035b69ef271817eb7cab90f6d4302edde57dd41a1db9554f987])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6ec0eed2731c035b69ef271817eb7cab90f6d4302edde57dd41a1db9554f987
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6ec0eed2731c035b69ef271817eb7cab90f6d4302edde57dd41a1db9554f987].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 40s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/wahsjbaa33jcs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1658
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1658/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520142039",
"environmentId": "XfJwQHcZtubeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-143144"
}
]
},
"name": "go-testxlang_partition-556",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/20 15:14:47 Submitted job: 2023-05-20_08_14_46-2290105523509943264
2023/05/20 15:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-20_08_14_46-2290105523509943264?project=apache-beam-testing
2023/05/20 15:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-20_08_14_46-2290105523509943264
2023/05/20 15:14:47 Job state: JOB_STATE_PENDING ...
2023/05/20 15:15:17 Job still running ...
2023/05/20 15:15:47 Job still running ...
2023/05/20 15:16:17 Job still running ...
2023/05/20 15:16:47 Job still running ...
2023/05/20 15:17:17 Job still running ...
2023/05/20 15:17:47 Job still running ...
2023/05/20 15:18:17 Job still running ...
2023/05/20 15:18:47 Job still running ...
2023/05/20 15:19:17 Job still running ...
2023/05/20 15:19:47 Job still running ...
2023/05/20 15:20:17 Job still running ...
2023/05/20 15:20:47 Job still running ...
2023/05/20 15:21:17 Job still running ...
2023/05/20 15:21:47 Job still running ...
2023/05/20 15:22:17 Job still running ...
2023/05/20 15:22:47 Job still running ...
2023/05/20 15:23:17 Job still running ...
2023/05/20 15:23:47 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-20_08_14_46-2290105523509943264 failed
--- FAIL: TestXLang_Partition (580.14s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3122.043s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684593139104394789
--- FAIL: TestBigQueryIO_BasicWriteRead (4.98s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45379 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ufZucEfAcB" is_bounded:BOUNDED windowing_strategy_id:"w0@ufZucEfAcB"}} windowing_strategies:{key:"w0@ufZucEfAcB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ufZucEfAcB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ufZucEfAcB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ufZucEfAcB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684593139104394789\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ufZucEfAcB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45379 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ufZucEfAcB" is_bounded:BOUNDED windowing_strategy_id:"w0@ufZucEfAcB"}} windowing_strategies:{key:"w0@ufZucEfAcB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ufZucEfAcB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ufZucEfAcB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ufZucEfAcB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684593139104394789\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ufZucEfAcB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 36 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc00019e880})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc00019e880})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004fc0a0?, 0xc0000c0050?}, {0x11cb21b, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000489f80, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004fc020?, 0xc0000c0050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010ec00, 0x52}, {0xf26ee0, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000351860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000351860, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.006s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-143144
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-143144
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c54510884615e5f3cd12bbc7f5a81132cf0c11063a243131bbc55849970d19ef
Deleted: sha256:92bf5e15489a45d338302b732378766788b893efc35c255a26175feafaf0f9f9
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-143144
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c54510884615e5f3cd12bbc7f5a81132cf0c11063a243131bbc55849970d19ef
Associated tags:
- 20230520-143144
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-143144
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-143144].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c54510884615e5f3cd12bbc7f5a81132cf0c11063a243131bbc55849970d19ef].
$ rm -rf /tmp/tmp.ieQKwmSoE4
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520142039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241a7c80108ccb1f305bc02dc625aea7efbaca5d3845f5132ee5c4952df80210
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241a7c80108ccb1f305bc02dc625aea7efbaca5d3845f5132ee5c4952df80210]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241a7c80108ccb1f305bc02dc625aea7efbaca5d3845f5132ee5c4952df80210])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241a7c80108ccb1f305bc02dc625aea7efbaca5d3845f5132ee5c4952df80210
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241a7c80108ccb1f305bc02dc625aea7efbaca5d3845f5132ee5c4952df80210
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241a7c80108ccb1f305bc02dc625aea7efbaca5d3845f5132ee5c4952df80210].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520142039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:37437463c04c16689872dc856cf4b9e79fe1283cda9fab626e17a803f37c5237
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:37437463c04c16689872dc856cf4b9e79fe1283cda9fab626e17a803f37c5237]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:37437463c04c16689872dc856cf4b9e79fe1283cda9fab626e17a803f37c5237])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:37437463c04c16689872dc856cf4b9e79fe1283cda9fab626e17a803f37c5237
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:37437463c04c16689872dc856cf4b9e79fe1283cda9fab626e17a803f37c5237
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:37437463c04c16689872dc856cf4b9e79fe1283cda9fab626e17a803f37c5237].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3983016.
Stopping expansion service pid: 3983017.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 5s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/oadwknrnjgzxy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1657
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1657/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520082028",
"environmentId": "qbOiismHMybeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-083120"
}
]
},
"name": "go-testxlang_partition-306",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/20 09:15:28 Submitted job: 2023-05-20_02_15_27-1923343771428279277
2023/05/20 09:15:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-20_02_15_27-1923343771428279277?project=apache-beam-testing
2023/05/20 09:15:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-20_02_15_27-1923343771428279277
2023/05/20 09:15:28 Job state: JOB_STATE_PENDING ...
2023/05/20 09:15:58 Job still running ...
2023/05/20 09:16:28 Job still running ...
2023/05/20 09:16:58 Job still running ...
2023/05/20 09:17:28 Job still running ...
2023/05/20 09:17:58 Job still running ...
2023/05/20 09:18:28 Job still running ...
2023/05/20 09:18:58 Job still running ...
2023/05/20 09:19:28 Job still running ...
2023/05/20 09:19:58 Job still running ...
2023/05/20 09:20:28 Job still running ...
2023/05/20 09:20:58 Job still running ...
2023/05/20 09:21:28 Job still running ...
2023/05/20 09:21:58 Job still running ...
2023/05/20 09:22:28 Job still running ...
2023/05/20 09:22:58 Job still running ...
2023/05/20 09:23:28 Job still running ...
2023/05/20 09:23:58 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-20_02_15_27-1923343771428279277 failed
--- FAIL: TestXLang_Partition (551.17s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3153.477s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684571518727327051
--- FAIL: TestBigQueryIO_BasicWriteRead (4.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45365 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RtcLTYzuvr" is_bounded:BOUNDED windowing_strategy_id:"w0@RtcLTYzuvr"}} windowing_strategies:{key:"w0@RtcLTYzuvr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RtcLTYzuvr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RtcLTYzuvr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RtcLTYzuvr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684571518727327051\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RtcLTYzuvr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45365 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RtcLTYzuvr" is_bounded:BOUNDED windowing_strategy_id:"w0@RtcLTYzuvr"}} windowing_strategies:{key:"w0@RtcLTYzuvr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RtcLTYzuvr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RtcLTYzuvr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RtcLTYzuvr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684571518727327051\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RtcLTYzuvr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 22 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc00020abc0})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc00020abc0})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005920a0?, 0xc000594000?}, {0x11cb21b, 0x39}, {0xc0000f4180?, 0x10ca800?, 0x41bcd1?}, {0xc00046df00, 0xf}, 0xc0000f1d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000592020?, 0xc000594000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc0000f1ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046df00, 0xf}, {0xc000050ea0, 0x52}, {0xf26ee0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004dbd40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004dbd40, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.682s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-083120
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-083120
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a2b1915b2649c669626fd807e2417e71bfbb403fc755593a287bea7c306ed993
Deleted: sha256:fb18cc558d669004e1fc7ca23a3010f8be08d01f459d4a0dd115498def93289f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-083120
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a2b1915b2649c669626fd807e2417e71bfbb403fc755593a287bea7c306ed993
Associated tags:
- 20230520-083120
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-083120
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-083120].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a2b1915b2649c669626fd807e2417e71bfbb403fc755593a287bea7c306ed993].
$ rm -rf /tmp/tmp.O9EqSt9E8z
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520082028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:51f72ccc45e1989cc456a627587f51370afccdced167db2872f71b5684dc7ed5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:51f72ccc45e1989cc456a627587f51370afccdced167db2872f71b5684dc7ed5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:51f72ccc45e1989cc456a627587f51370afccdced167db2872f71b5684dc7ed5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:51f72ccc45e1989cc456a627587f51370afccdced167db2872f71b5684dc7ed5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:51f72ccc45e1989cc456a627587f51370afccdced167db2872f71b5684dc7ed5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:51f72ccc45e1989cc456a627587f51370afccdced167db2872f71b5684dc7ed5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520082028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d904e55243fa0d6cf8487632ae8e0abaf568f5be760a88230a410725aff826a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d904e55243fa0d6cf8487632ae8e0abaf568f5be760a88230a410725aff826a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d904e55243fa0d6cf8487632ae8e0abaf568f5be760a88230a410725aff826a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d904e55243fa0d6cf8487632ae8e0abaf568f5be760a88230a410725aff826a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d904e55243fa0d6cf8487632ae8e0abaf568f5be760a88230a410725aff826a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d904e55243fa0d6cf8487632ae8e0abaf568f5be760a88230a410725aff826a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3816056.
Stopping expansion service pid: 3816057.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 27s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/j5gabn2yrdf5q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1656
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1656/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-023135",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520022040",
"environmentId": "stjLocxphobeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-023135"
}
]
},
"name": "go-testxlang_partition-226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/20 03:15:37 Submitted job: 2023-05-19_20_15_36-1593928292338712927
2023/05/20 03:15:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-19_20_15_36-1593928292338712927?project=apache-beam-testing
2023/05/20 03:15:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-19_20_15_36-1593928292338712927
2023/05/20 03:15:37 Job state: JOB_STATE_PENDING ...
2023/05/20 03:16:07 Job still running ...
2023/05/20 03:16:37 Job still running ...
2023/05/20 03:17:07 Job still running ...
2023/05/20 03:17:37 Job still running ...
2023/05/20 03:18:07 Job still running ...
2023/05/20 03:18:37 Job still running ...
2023/05/20 03:19:07 Job still running ...
2023/05/20 03:19:37 Job still running ...
2023/05/20 03:20:07 Job still running ...
2023/05/20 03:20:37 Job still running ...
2023/05/20 03:21:07 Job still running ...
2023/05/20 03:21:37 Job still running ...
2023/05/20 03:22:07 Job still running ...
2023/05/20 03:22:37 Job still running ...
2023/05/20 03:23:07 Job still running ...
2023/05/20 03:23:37 Job still running ...
2023/05/20 03:24:07 Job still running ...
2023/05/20 03:24:37 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-19_20_15_36-1593928292338712927 failed
--- FAIL: TestXLang_Partition (581.98s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3179.365s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684549931720920369
--- FAIL: TestBigQueryIO_BasicWriteRead (4.51s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jFblYFZFbA" is_bounded:BOUNDED windowing_strategy_id:"w0@jFblYFZFbA"}} windowing_strategies:{key:"w0@jFblYFZFbA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jFblYFZFbA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jFblYFZFbA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jFblYFZFbA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684549931720920369\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jFblYFZFbA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jFblYFZFbA" is_bounded:BOUNDED windowing_strategy_id:"w0@jFblYFZFbA"}} windowing_strategies:{key:"w0@jFblYFZFbA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jFblYFZFbA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jFblYFZFbA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jFblYFZFbA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684549931720920369\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jFblYFZFbA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 24 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc0003ec780})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc0003ec780})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00016cba0?, 0xc000136320?}, {0x11cb21b, 0x39}, {0xc000158180?, 0x10ca800?, 0x41bcd1?}, {0xc000045f40, 0xf}, 0xc0002d3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00016cb00?, 0xc000136320?}, {0xc000050960, 0x52}, {0x1?}, {0xc0002d3ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc000050960, 0x52}, {0xf26ee0, 0xc000489330})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000cb1e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000cb1e0, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.531s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2173c1ef5e364df882f64afec16d52e4af14326d2f275865d262ff7ca16aab22
Associated tags:
- 20230520-023135
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-023135
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230520-023135].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2173c1ef5e364df882f64afec16d52e4af14326d2f275865d262ff7ca16aab22].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32c44c0082dcbae2e45cad45374c99786d04f8cace41462328b469997c3a4dbf]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230520022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32c44c0082dcbae2e45cad45374c99786d04f8cace41462328b469997c3a4dbf])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32c44c0082dcbae2e45cad45374c99786d04f8cace41462328b469997c3a4dbf
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32c44c0082dcbae2e45cad45374c99786d04f8cace41462328b469997c3a4dbf].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ad9f197d64e62249e133a227b600db5218f059b7bd57f63f9f87eb95c80ec6eb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230520022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ad9f197d64e62249e133a227b600db5218f059b7bd57f63f9f87eb95c80ec6eb])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ad9f197d64e62249e133a227b600db5218f059b7bd57f63f9f87eb95c80ec6eb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ad9f197d64e62249e133a227b600db5218f059b7bd57f63f9f87eb95c80ec6eb].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 54s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/rxil4q7falw7y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1655
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1655/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519202042",
"environmentId": "kAIcXspZOSbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-203430"
}
]
},
"name": "go-testxlang_partition-715",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/19 21:18:15 Submitted job: 2023-05-19_14_18_15-11252738576413541938
2023/05/19 21:18:15 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-19_14_18_15-11252738576413541938?project=apache-beam-testing
2023/05/19 21:18:15 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-19_14_18_15-11252738576413541938
2023/05/19 21:18:15 Job state: JOB_STATE_PENDING ...
2023/05/19 21:18:45 Job still running ...
2023/05/19 21:19:15 Job still running ...
2023/05/19 21:19:45 Job still running ...
2023/05/19 21:20:16 Job still running ...
2023/05/19 21:20:46 Job still running ...
2023/05/19 21:21:16 Job still running ...
2023/05/19 21:21:46 Job still running ...
2023/05/19 21:22:16 Job still running ...
2023/05/19 21:22:46 Job still running ...
2023/05/19 21:23:16 Job still running ...
2023/05/19 21:23:46 Job still running ...
2023/05/19 21:24:16 Job still running ...
2023/05/19 21:24:46 Job still running ...
2023/05/19 21:25:16 Job still running ...
2023/05/19 21:25:46 Job still running ...
2023/05/19 21:26:16 Job still running ...
2023/05/19 21:26:46 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-19_14_18_15-11252738576413541938 failed
--- FAIL: TestXLang_Partition (551.14s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3127.452s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684528518200044496
--- FAIL: TestBigQueryIO_BasicWriteRead (5.99s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34965 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bDuoHlyCNw" is_bounded:BOUNDED windowing_strategy_id:"w0@bDuoHlyCNw"}} windowing_strategies:{key:"w0@bDuoHlyCNw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bDuoHlyCNw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bDuoHlyCNw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bDuoHlyCNw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684528518200044496\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bDuoHlyCNw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34965 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bDuoHlyCNw" is_bounded:BOUNDED windowing_strategy_id:"w0@bDuoHlyCNw"}} windowing_strategies:{key:"w0@bDuoHlyCNw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bDuoHlyCNw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bDuoHlyCNw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bDuoHlyCNw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684528518200044496\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bDuoHlyCNw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe27c0, 0xc0006ea440})
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1529 +0x39f
panic({0xfe27c0, 0xc0006ea440})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006500c0?, 0xc00011e000?}, {0x11cb21b, 0x39}, {0xc0001280c0?, 0x10ca800?, 0x41bcd1?}, {0xc00046de50, 0xf}, 0xc0001a3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000650040?, 0xc00011e000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc0001a3ea8, 0x2, 0xee22c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de50, 0xf}, {0xc000050f00, 0x52}, {0xf26ee0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2d00, 0x11fe750)
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.4/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.019s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-203430
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-203430
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:11ea3cb141d6aae02bf44b7211ecc8e54ee6c5e84c34bb1d8e4a15b44af48642
Deleted: sha256:10be52d88ad72eeedb9cc9e49c218ce1c7433e45d3524bfafc11a13d14bf7bab
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-203430
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:11ea3cb141d6aae02bf44b7211ecc8e54ee6c5e84c34bb1d8e4a15b44af48642
Associated tags:
- 20230519-203430
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-203430
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-203430].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:11ea3cb141d6aae02bf44b7211ecc8e54ee6c5e84c34bb1d8e4a15b44af48642].
$ rm -rf /tmp/tmp.ALyV5W8tqZ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519202042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e0c500a8f9bbe0484c091bdd04444849987fb1f09594b2b57a26993ed0c806f3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519202042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e0c500a8f9bbe0484c091bdd04444849987fb1f09594b2b57a26993ed0c806f3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519202042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e0c500a8f9bbe0484c091bdd04444849987fb1f09594b2b57a26993ed0c806f3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e0c500a8f9bbe0484c091bdd04444849987fb1f09594b2b57a26993ed0c806f3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e0c500a8f9bbe0484c091bdd04444849987fb1f09594b2b57a26993ed0c806f3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e0c500a8f9bbe0484c091bdd04444849987fb1f09594b2b57a26993ed0c806f3].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519202042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bfbd50a5d687ad7b10b03d25dba5db3a058f42fb920747df20b0d01292a1677
Deleted: sha256:d7cdd7e5a5a73c6a5bd18dcecf55e8d4cfc698086f05f610c84274aef3da0058
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519202042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bfbd50a5d687ad7b10b03d25dba5db3a058f42fb920747df20b0d01292a1677]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519202042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bfbd50a5d687ad7b10b03d25dba5db3a058f42fb920747df20b0d01292a1677])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bfbd50a5d687ad7b10b03d25dba5db3a058f42fb920747df20b0d01292a1677
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bfbd50a5d687ad7b10b03d25dba5db3a058f42fb920747df20b0d01292a1677
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bfbd50a5d687ad7b10b03d25dba5db3a058f42fb920747df20b0d01292a1677].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3181437.
Stopping expansion service pid: 3181438.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 3s
232 actionable tasks: 202 executed, 20 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ssgnmj7c2zxcm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1654
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1654/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-144819",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-144819"
}
]
},
"name": "go-testxlang_partition-374",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/19 15:31:10 Submitted job: 2023-05-19_08_31_09-12109794394667391212
2023/05/19 15:31:10 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-19_08_31_09-12109794394667391212?project=apache-beam-testing
2023/05/19 15:31:10 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-19_08_31_09-12109794394667391212
2023/05/19 15:31:10 Job state: JOB_STATE_PENDING ...
2023/05/19 15:31:40 Job still running ...
2023/05/19 15:32:10 Job still running ...
2023/05/19 15:32:40 Job still running ...
2023/05/19 15:33:10 Job still running ...
2023/05/19 15:33:40 Job still running ...
2023/05/19 15:34:10 Job still running ...
2023/05/19 15:34:40 Job still running ...
2023/05/19 15:35:10 Job still running ...
2023/05/19 15:35:40 Job still running ...
2023/05/19 15:36:10 Job still running ...
2023/05/19 15:36:40 Job still running ...
2023/05/19 15:37:10 Job still running ...
2023/05/19 15:37:41 Job still running ...
2023/05/19 15:38:11 Job still running ...
2023/05/19 15:38:41 Job still running ...
2023/05/19 15:39:11 Job still running ...
2023/05/19 15:39:41 Job still running ...
2023/05/19 15:40:11 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-19_08_31_09-12109794394667391212 failed
--- FAIL: TestXLang_Partition (580.87s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3100.348s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684507749315003449
--- FAIL: TestBigQueryIO_BasicWriteRead (5.57s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40121 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@HRbTDsoPPk" is_bounded:BOUNDED windowing_strategy_id:"w0@HRbTDsoPPk"}} windowing_strategies:{key:"w0@HRbTDsoPPk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@HRbTDsoPPk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@HRbTDsoPPk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@HRbTDsoPPk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684507749315003449\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"HRbTDsoPPk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40121 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@HRbTDsoPPk" is_bounded:BOUNDED windowing_strategy_id:"w0@HRbTDsoPPk"}} windowing_strategies:{key:"w0@HRbTDsoPPk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@HRbTDsoPPk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@HRbTDsoPPk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@HRbTDsoPPk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684507749315003449\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"HRbTDsoPPk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc000282200})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc000282200})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aa9c0?, 0xc0005683c0?}, {0x11c9fad, 0x39}, {0xc0000f4240?, 0x10c9600?, 0x1?}, {0xc00046de50, 0xf}, 0xc000575d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aa4e0?, 0xc0005683c0?}, {0xc000050f00, 0x52}, {0x1?}, {0xc000575ea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de50, 0xf}, {0xc000050f00, 0x52}, {0xf25e80, 0xc000627200})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001036c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001036c0, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.600s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.050s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-144819
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-144819
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b865a494da6d689b730daf6d5c8341ec8d245a51967d92ee181b7bf26d64f048
Deleted: sha256:ef463167335a312e0c6c47d99814704c0810318850ea1f2d712300aacc27566f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-144819
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b865a494da6d689b730daf6d5c8341ec8d245a51967d92ee181b7bf26d64f048
Associated tags:
- 20230519-144819
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-144819
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-144819].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b865a494da6d689b730daf6d5c8341ec8d245a51967d92ee181b7bf26d64f048].
$ rm -rf /tmp/tmp.BW7jDBvMAZ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519143012
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:937a567eba658150a0847e9ca64ec96a50b00db9f1517482fafc4b92e530ac5e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519143012]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:937a567eba658150a0847e9ca64ec96a50b00db9f1517482fafc4b92e530ac5e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519143012] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:937a567eba658150a0847e9ca64ec96a50b00db9f1517482fafc4b92e530ac5e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:937a567eba658150a0847e9ca64ec96a50b00db9f1517482fafc4b92e530ac5e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:937a567eba658150a0847e9ca64ec96a50b00db9f1517482fafc4b92e530ac5e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:937a567eba658150a0847e9ca64ec96a50b00db9f1517482fafc4b92e530ac5e].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519143012
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5366a8c9cb8d42ad181fb9c86c1934dd1f2e8202d8afd1630cc0eaf0fbb6ea44
Deleted: sha256:75c75b3c439cbdecf4f95745e8aebd7936265ba88e919e3006ed97ffad197ed7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519143012]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5366a8c9cb8d42ad181fb9c86c1934dd1f2e8202d8afd1630cc0eaf0fbb6ea44]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519143012] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5366a8c9cb8d42ad181fb9c86c1934dd1f2e8202d8afd1630cc0eaf0fbb6ea44])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5366a8c9cb8d42ad181fb9c86c1934dd1f2e8202d8afd1630cc0eaf0fbb6ea44
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5366a8c9cb8d42ad181fb9c86c1934dd1f2e8202d8afd1630cc0eaf0fbb6ea44
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5366a8c9cb8d42ad181fb9c86c1934dd1f2e8202d8afd1630cc0eaf0fbb6ea44].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1524939.
Stopping expansion service pid: 1524940.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 11m 28s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/hpe7z463n45gq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_XVR_GoUsingJava_Dataflow - Build # 1653 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_GoUsingJava_Dataflow - Build # 1653 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1653/ to view the results.
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1652
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1652/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519022102",
"environmentId": "ZlDrczvLSmbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-023611"
}
]
},
"name": "go-testxlang_partition-389",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/19 03:20:30 Submitted job: 2023-05-18_20_20_30-10353307611630353436
2023/05/19 03:20:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-18_20_20_30-10353307611630353436?project=apache-beam-testing
2023/05/19 03:20:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-18_20_20_30-10353307611630353436
2023/05/19 03:20:30 Job state: JOB_STATE_PENDING ...
2023/05/19 03:21:01 Job still running ...
2023/05/19 03:21:31 Job still running ...
2023/05/19 03:22:01 Job still running ...
2023/05/19 03:22:31 Job still running ...
2023/05/19 03:23:01 Job still running ...
2023/05/19 03:23:31 Job still running ...
2023/05/19 03:24:01 Job still running ...
2023/05/19 03:24:31 Job still running ...
2023/05/19 03:25:01 Job still running ...
2023/05/19 03:25:31 Job still running ...
2023/05/19 03:26:01 Job still running ...
2023/05/19 03:26:31 Job still running ...
2023/05/19 03:27:01 Job still running ...
2023/05/19 03:27:31 Job still running ...
2023/05/19 03:28:01 Job still running ...
2023/05/19 03:28:31 Job still running ...
2023/05/19 03:29:01 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-18_20_20_30-10353307611630353436 failed
--- FAIL: TestXLang_Partition (550.66s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3152.168s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684463822676444192
--- FAIL: TestBigQueryIO_BasicWriteRead (6.23s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35139 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ynmtCBlPsu" is_bounded:BOUNDED windowing_strategy_id:"w0@ynmtCBlPsu"}} windowing_strategies:{key:"w0@ynmtCBlPsu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ynmtCBlPsu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ynmtCBlPsu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ynmtCBlPsu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684463822676444192\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ynmtCBlPsu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35139 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ynmtCBlPsu" is_bounded:BOUNDED windowing_strategy_id:"w0@ynmtCBlPsu"}} windowing_strategies:{key:"w0@ynmtCBlPsu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ynmtCBlPsu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ynmtCBlPsu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ynmtCBlPsu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684463822676444192\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ynmtCBlPsu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc000284680})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc000284680})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005960a0?, 0xc000598000?}, {0x11c9fad, 0x39}, {0xc0000f4180?, 0x10c9600?, 0x41bc91?}, {0xc00069bdd0, 0xf}, 0xc000205d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000596020?, 0xc000598000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc000205ea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00069bdd0, 0xf}, {0xc000050ea0, 0x52}, {0xf25e80, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103860, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.257s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.057s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-023611
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-023611
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:470ba0e2248cb3b9ac38aced9cdfe1fdea7cd6702fd598ed4b15a217beabe482
Deleted: sha256:eca5ee868701604018bcfe5e74070deb6d679d96c60cfd1a680ccfda957320ab
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-023611
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:470ba0e2248cb3b9ac38aced9cdfe1fdea7cd6702fd598ed4b15a217beabe482
Associated tags:
- 20230519-023611
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-023611
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230519-023611].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:470ba0e2248cb3b9ac38aced9cdfe1fdea7cd6702fd598ed4b15a217beabe482].
$ rm -rf /tmp/tmp.5B5A00KwEJ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519022102
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ae4957b869db14898e91a340e27cb73a30a2c1c25452f0b7363bc4289a01a10
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519022102]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ae4957b869db14898e91a340e27cb73a30a2c1c25452f0b7363bc4289a01a10]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230519022102] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ae4957b869db14898e91a340e27cb73a30a2c1c25452f0b7363bc4289a01a10])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ae4957b869db14898e91a340e27cb73a30a2c1c25452f0b7363bc4289a01a10
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ae4957b869db14898e91a340e27cb73a30a2c1c25452f0b7363bc4289a01a10
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ae4957b869db14898e91a340e27cb73a30a2c1c25452f0b7363bc4289a01a10].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519022102
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:91ecbe96a6e35bb3027a202539212725f82fe19579d5c6e9115ed00b6bd1d626
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519022102]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:91ecbe96a6e35bb3027a202539212725f82fe19579d5c6e9115ed00b6bd1d626]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230519022102] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:91ecbe96a6e35bb3027a202539212725f82fe19579d5c6e9115ed00b6bd1d626])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:91ecbe96a6e35bb3027a202539212725f82fe19579d5c6e9115ed00b6bd1d626
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:91ecbe96a6e35bb3027a202539212725f82fe19579d5c6e9115ed00b6bd1d626
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:91ecbe96a6e35bb3027a202539212725f82fe19579d5c6e9115ed00b6bd1d626].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1917080.
Stopping expansion service pid: 1917081.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 16s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/tcjxtrc65luu2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1651
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1651/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518202056",
"environmentId": "LnXBoWxJkabeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-203622"
}
]
},
"name": "go-testxlang_partition-215",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/18 21:20:17 Submitted job: 2023-05-18_14_20_16-4128475244722021445
2023/05/18 21:20:17 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-18_14_20_16-4128475244722021445?project=apache-beam-testing
2023/05/18 21:20:17 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-18_14_20_16-4128475244722021445
2023/05/18 21:20:17 Job state: JOB_STATE_PENDING ...
2023/05/18 21:20:47 Job still running ...
2023/05/18 21:21:17 Job still running ...
2023/05/18 21:21:47 Job still running ...
2023/05/18 21:22:18 Job still running ...
2023/05/18 21:22:48 Job still running ...
2023/05/18 21:23:18 Job still running ...
2023/05/18 21:23:48 Job still running ...
2023/05/18 21:24:18 Job still running ...
2023/05/18 21:24:48 Job still running ...
2023/05/18 21:25:18 Job still running ...
2023/05/18 21:25:48 Job still running ...
2023/05/18 21:26:18 Job still running ...
2023/05/18 21:26:48 Job still running ...
2023/05/18 21:27:18 Job still running ...
2023/05/18 21:27:48 Job still running ...
2023/05/18 21:28:18 Job still running ...
2023/05/18 21:28:48 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-18_14_20_16-4128475244722021445 failed
--- FAIL: TestXLang_Partition (553.72s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3133.112s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684442228931500182
--- FAIL: TestBigQueryIO_BasicWriteRead (4.97s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38647 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@eZsukkNJiN" is_bounded:BOUNDED windowing_strategy_id:"w0@eZsukkNJiN"}} windowing_strategies:{key:"w0@eZsukkNJiN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@eZsukkNJiN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@eZsukkNJiN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@eZsukkNJiN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684442228931500182\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"eZsukkNJiN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38647 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@eZsukkNJiN" is_bounded:BOUNDED windowing_strategy_id:"w0@eZsukkNJiN"}} windowing_strategies:{key:"w0@eZsukkNJiN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@eZsukkNJiN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@eZsukkNJiN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@eZsukkNJiN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684442228931500182\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"eZsukkNJiN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 6 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc0001a0900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc0001a0900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0007000c0?, 0xc0000c0050?}, {0x11c9fad, 0x39}, {0xc000158180?, 0x10c9600?, 0x41bc91?}, {0xc000489f70, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000700040?, 0xc0000c0050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f70, 0xf}, {0xc00010ec00, 0x52}, {0xf25e80, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000351380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000351380, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.002s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-203622
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-203622
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c3a0cd6d4f537eff07563bc019f982595cbb11d5e562eafc4814edb4ea000f4a
Deleted: sha256:07bfe2f556ff14c08dfdea422f72c14aed9ddcd320ae35ab7a1287e1b656e28d
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-203622
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c3a0cd6d4f537eff07563bc019f982595cbb11d5e562eafc4814edb4ea000f4a
Associated tags:
- 20230518-203622
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-203622
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-203622].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c3a0cd6d4f537eff07563bc019f982595cbb11d5e562eafc4814edb4ea000f4a].
$ rm -rf /tmp/tmp.TSdnrFuF7U
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518202056
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fe5a847fd03d669e13b439b33bd803f6238eeb7c6b3c5d85f83eac486c6eb1b1
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518202056]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fe5a847fd03d669e13b439b33bd803f6238eeb7c6b3c5d85f83eac486c6eb1b1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518202056] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fe5a847fd03d669e13b439b33bd803f6238eeb7c6b3c5d85f83eac486c6eb1b1])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fe5a847fd03d669e13b439b33bd803f6238eeb7c6b3c5d85f83eac486c6eb1b1
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fe5a847fd03d669e13b439b33bd803f6238eeb7c6b3c5d85f83eac486c6eb1b1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fe5a847fd03d669e13b439b33bd803f6238eeb7c6b3c5d85f83eac486c6eb1b1].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518202056
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:273dec6044fb4d45bd775c4d68edf4388d48367bb9fd49d8e8374cc5e3f72e96
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518202056]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:273dec6044fb4d45bd775c4d68edf4388d48367bb9fd49d8e8374cc5e3f72e96]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518202056] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:273dec6044fb4d45bd775c4d68edf4388d48367bb9fd49d8e8374cc5e3f72e96])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:273dec6044fb4d45bd775c4d68edf4388d48367bb9fd49d8e8374cc5e3f72e96
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:273dec6044fb4d45bd775c4d68edf4388d48367bb9fd49d8e8374cc5e3f72e96
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:273dec6044fb4d45bd775c4d68edf4388d48367bb9fd49d8e8374cc5e3f72e96].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1097199.
Stopping expansion service pid: 1097200.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 8s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/erlo4prde2mq6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1650
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1650/display/redirect?page=changes>
Changes:
[noreply] Update cut_release_branch.yml with pr creation permissions (#26763)
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518142107",
"environmentId": "UwXEhLVrrpbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-143812",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-143812"
}
]
},
"name": "go-testxlang_partition-17",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/18 15:25:35 Submitted job: 2023-05-18_08_25_34-13731095914987171991
2023/05/18 15:25:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-18_08_25_34-13731095914987171991?project=apache-beam-testing
2023/05/18 15:25:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-18_08_25_34-13731095914987171991
2023/05/18 15:25:35 Job state: JOB_STATE_PENDING ...
2023/05/18 15:26:05 Job still running ...
2023/05/18 15:26:35 Job still running ...
2023/05/18 15:27:05 Job still running ...
2023/05/18 15:27:35 Job still running ...
2023/05/18 15:28:05 Job still running ...
2023/05/18 15:28:35 Job still running ...
2023/05/18 15:29:05 Job still running ...
2023/05/18 15:29:35 Job still running ...
2023/05/18 15:30:05 Job still running ...
2023/05/18 15:30:35 Job still running ...
2023/05/18 15:31:06 Job still running ...
2023/05/18 15:31:36 Job still running ...
2023/05/18 15:32:06 Job still running ...
2023/05/18 15:32:36 Job still running ...
2023/05/18 15:33:06 Job still running ...
2023/05/18 15:33:36 Job still running ...
2023/05/18 15:34:06 Job still running ...
2023/05/18 15:34:36 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-18_08_25_34-13731095914987171991 failed
--- FAIL: TestXLang_Partition (582.47s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3330.258s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684420800789814084
--- FAIL: TestBigQueryIO_BasicWriteRead (25.62s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42567 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MEEzmvtaSI" is_bounded:BOUNDED windowing_strategy_id:"w0@MEEzmvtaSI"}} windowing_strategies:{key:"w0@MEEzmvtaSI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MEEzmvtaSI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MEEzmvtaSI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MEEzmvtaSI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684420800789814084\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MEEzmvtaSI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42567 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MEEzmvtaSI" is_bounded:BOUNDED windowing_strategy_id:"w0@MEEzmvtaSI"}} windowing_strategies:{key:"w0@MEEzmvtaSI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MEEzmvtaSI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MEEzmvtaSI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MEEzmvtaSI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684420800789814084\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MEEzmvtaSI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 20 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc000324c40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc000324c40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000d20a0?, 0xc000524050?}, {0x11c9fad, 0x39}, {0xc000158180?, 0x10c9600?, 0x41bc91?}, {0xc000045e00, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000d2020?, 0xc000524050?}, {0xc000050960, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045e00, 0xf}, {0xc000050960, 0x52}, {0xf25e80, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503ba0, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 28.754s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.143s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.255s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.196s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:66293964db7b64f31eaa61559e831b28ae163cf113749b55dd1489c717db7c9a
Associated tags:
- 20230518-143812
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-143812
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-143812].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:66293964db7b64f31eaa61559e831b28ae163cf113749b55dd1489c717db7c9a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518142107]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:941645489f6b5276463403b7196e62a3285bf8e65c4f1136501ae5f976a3b272]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518142107] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:941645489f6b5276463403b7196e62a3285bf8e65c4f1136501ae5f976a3b272])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:941645489f6b5276463403b7196e62a3285bf8e65c4f1136501ae5f976a3b272
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:941645489f6b5276463403b7196e62a3285bf8e65c4f1136501ae5f976a3b272].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518142107]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6111aa5bb45d2ae21eab83993f6d60960831dd4b6f84aed486a660b8221b4a00]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518142107] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6111aa5bb45d2ae21eab83993f6d60960831dd4b6f84aed486a660b8221b4a00])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6111aa5bb45d2ae21eab83993f6d60960831dd4b6f84aed486a660b8221b4a00
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6111aa5bb45d2ae21eab83993f6d60960831dd4b6f84aed486a660b8221b4a00].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 14m 53s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/lymyw3itcgzqw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1649
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1649/display/redirect>
Changes:
------------------------------------------
[...truncated 1.07 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518082103",
"environmentId": "HReAqnIslRbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-083541"
}
]
},
"name": "go-testxlang_partition-592",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/18 09:20:15 Submitted job: 2023-05-18_02_20_15-1875429118889133874
2023/05/18 09:20:15 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-18_02_20_15-1875429118889133874?project=apache-beam-testing
2023/05/18 09:20:15 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-18_02_20_15-1875429118889133874
2023/05/18 09:20:15 Job state: JOB_STATE_PENDING ...
2023/05/18 09:20:45 Job still running ...
2023/05/18 09:21:15 Job still running ...
2023/05/18 09:21:45 Job still running ...
2023/05/18 09:22:16 Job still running ...
2023/05/18 09:22:46 Job still running ...
2023/05/18 09:23:16 Job still running ...
2023/05/18 09:23:46 Job still running ...
2023/05/18 09:24:16 Job still running ...
2023/05/18 09:24:46 Job still running ...
2023/05/18 09:25:16 Job still running ...
2023/05/18 09:25:46 Job still running ...
2023/05/18 09:26:16 Job still running ...
2023/05/18 09:26:46 Job still running ...
2023/05/18 09:27:16 Job still running ...
2023/05/18 09:27:46 Job still running ...
2023/05/18 09:28:16 Job still running ...
2023/05/18 09:28:46 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-18_02_20_15-1875429118889133874 failed
--- FAIL: TestXLang_Partition (552.30s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3171.565s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684398995894606147
--- FAIL: TestBigQueryIO_BasicWriteRead (6.94s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37959 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lLDwTMSRdp" is_bounded:BOUNDED windowing_strategy_id:"w0@lLDwTMSRdp"}} windowing_strategies:{key:"w0@lLDwTMSRdp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lLDwTMSRdp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lLDwTMSRdp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lLDwTMSRdp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684398995894606147\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lLDwTMSRdp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37959 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lLDwTMSRdp" is_bounded:BOUNDED windowing_strategy_id:"w0@lLDwTMSRdp"}} windowing_strategies:{key:"w0@lLDwTMSRdp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lLDwTMSRdp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lLDwTMSRdp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lLDwTMSRdp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684398995894606147\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lLDwTMSRdp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc00013e400})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc00013e400})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006ce0c0?, 0xc0000c0280?}, {0x11c9fad, 0x39}, {0xc0000f4180?, 0x10c9600?, 0x41bc91?}, {0xc00046b990, 0xf}, 0xc00056bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006ce040?, 0xc0000c0280?}, {0xc0005a2840, 0x52}, {0x1?}, {0xc00056bea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046b990, 0xf}, {0xc0005a2840, 0x52}, {0xf25e80, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000602b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000602b60, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.972s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.046s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-083541
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-083541
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:711d2d35bdefb4c3c983dbb1eedca9a24233adca1924dce8e2239b510f7f74b0
Deleted: sha256:f62c65465c84108a36d67e2ae10ece33017be672b65029a7ad14c0705f9f6f68
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-083541
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:711d2d35bdefb4c3c983dbb1eedca9a24233adca1924dce8e2239b510f7f74b0
Associated tags:
- 20230518-083541
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-083541
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-083541].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:711d2d35bdefb4c3c983dbb1eedca9a24233adca1924dce8e2239b510f7f74b0].
$ rm -rf /tmp/tmp.xhi9vUEGTx
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518082103
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3d0cebbe98983818307f8dd27aa2532d67db1e949b92cdf1cc0c4436018e7ea8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518082103]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3d0cebbe98983818307f8dd27aa2532d67db1e949b92cdf1cc0c4436018e7ea8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518082103] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3d0cebbe98983818307f8dd27aa2532d67db1e949b92cdf1cc0c4436018e7ea8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3d0cebbe98983818307f8dd27aa2532d67db1e949b92cdf1cc0c4436018e7ea8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3d0cebbe98983818307f8dd27aa2532d67db1e949b92cdf1cc0c4436018e7ea8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3d0cebbe98983818307f8dd27aa2532d67db1e949b92cdf1cc0c4436018e7ea8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518082103
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:718796e3513af38ce56cb0b800eafd7326ffbec91db8bf1ef1265ba0cb797f89
Deleted: sha256:4a91ddb6034424edb5c286453c5b6f0d5cf0bd0ba67de9aaacc4ef606428fca0
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518082103]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:718796e3513af38ce56cb0b800eafd7326ffbec91db8bf1ef1265ba0cb797f89]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518082103] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:718796e3513af38ce56cb0b800eafd7326ffbec91db8bf1ef1265ba0cb797f89])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:718796e3513af38ce56cb0b800eafd7326ffbec91db8bf1ef1265ba0cb797f89
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:718796e3513af38ce56cb0b800eafd7326ffbec91db8bf1ef1265ba0cb797f89
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:718796e3513af38ce56cb0b800eafd7326ffbec91db8bf1ef1265ba0cb797f89].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1110495.
Stopping expansion service pid: 1110496.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 55s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/k6qk3bze6ctds
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1648
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1648/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518022145",
"environmentId": "xerwowqehNbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-023728"
}
]
},
"name": "go-testxlang_partition-159",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/18 03:43:59 Submitted job: 2023-05-17_20_43_59-244590899781404097
2023/05/18 03:43:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-17_20_43_59-244590899781404097?project=apache-beam-testing
2023/05/18 03:43:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-17_20_43_59-244590899781404097
2023/05/18 03:43:59 Job state: JOB_STATE_PENDING ...
2023/05/18 03:44:29 Job still running ...
2023/05/18 03:44:59 Job still running ...
2023/05/18 03:45:29 Job still running ...
2023/05/18 03:46:00 Job still running ...
2023/05/18 03:46:30 Job still running ...
2023/05/18 03:47:00 Job still running ...
2023/05/18 03:47:30 Job still running ...
2023/05/18 03:48:00 Job still running ...
2023/05/18 03:48:30 Job still running ...
2023/05/18 03:49:00 Job still running ...
2023/05/18 03:49:30 Job still running ...
2023/05/18 03:50:00 Job still running ...
2023/05/18 03:50:30 Job still running ...
2023/05/18 03:51:00 Job still running ...
2023/05/18 03:51:30 Job still running ...
2023/05/18 03:52:00 Job still running ...
2023/05/18 03:52:30 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-17_20_43_59-244590899781404097 failed
--- FAIL: TestXLang_Partition (550.40s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 4502.591s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684377481089507754
--- FAIL: TestBigQueryIO_BasicWriteRead (6.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46459 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EtEPTXjQYo" is_bounded:BOUNDED windowing_strategy_id:"w0@EtEPTXjQYo"}} windowing_strategies:{key:"w0@EtEPTXjQYo" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EtEPTXjQYo" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EtEPTXjQYo" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EtEPTXjQYo" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684377481089507754\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EtEPTXjQYo"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46459 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EtEPTXjQYo" is_bounded:BOUNDED windowing_strategy_id:"w0@EtEPTXjQYo"}} windowing_strategies:{key:"w0@EtEPTXjQYo" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EtEPTXjQYo" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EtEPTXjQYo" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EtEPTXjQYo" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684377481089507754\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EtEPTXjQYo"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc0005723c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc0005723c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0007200e0?, 0xc0000c0280?}, {0x11c9fad, 0x39}, {0xc0005d80c0?, 0x10c9600?, 0x41bc91?}, {0xc0005b3d60, 0xf}, 0xc00056bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000720060?, 0xc0000c0280?}, {0xc000050f00, 0x52}, {0x1?}, {0xc00056bea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005b3d60, 0xf}, {0xc000050f00, 0x52}, {0xf25e80, 0xc000710088})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583380, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.681s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-023728
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-023728
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d4d880d0df2895b408d6bc915cae56fc15653d3a90126d8a8be10b307d03984b
Deleted: sha256:706a8eb2375c89099293a8a9fecfff3e7486d324b98aef82da90b3b462771a4c
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-023728
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d4d880d0df2895b408d6bc915cae56fc15653d3a90126d8a8be10b307d03984b
Associated tags:
- 20230518-023728
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-023728
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230518-023728].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d4d880d0df2895b408d6bc915cae56fc15653d3a90126d8a8be10b307d03984b].
$ rm -rf /tmp/tmp.KciMNW4opc
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518022145
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3b730bc4ddf24f4ee44f103e00ca2ed70f030cc5f4535391b2b0bfc411b77ba
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518022145]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3b730bc4ddf24f4ee44f103e00ca2ed70f030cc5f4535391b2b0bfc411b77ba]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230518022145] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3b730bc4ddf24f4ee44f103e00ca2ed70f030cc5f4535391b2b0bfc411b77ba])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3b730bc4ddf24f4ee44f103e00ca2ed70f030cc5f4535391b2b0bfc411b77ba
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3b730bc4ddf24f4ee44f103e00ca2ed70f030cc5f4535391b2b0bfc411b77ba
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3b730bc4ddf24f4ee44f103e00ca2ed70f030cc5f4535391b2b0bfc411b77ba].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518022145
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d2d97f97ade412449c5a42f1d49df5a5ff533adb5286fc030a5fb5062ac218
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518022145]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d2d97f97ade412449c5a42f1d49df5a5ff533adb5286fc030a5fb5062ac218]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230518022145] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d2d97f97ade412449c5a42f1d49df5a5ff533adb5286fc030a5fb5062ac218])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d2d97f97ade412449c5a42f1d49df5a5ff533adb5286fc030a5fb5062ac218
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d2d97f97ade412449c5a42f1d49df5a5ff533adb5286fc030a5fb5062ac218
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d2d97f97ade412449c5a42f1d49df5a5ff533adb5286fc030a5fb5062ac218].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4107636.
Stopping expansion service pid: 4107637.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 32m 36s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/yct2xwmn3tgik
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1647
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1647/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517202058",
"environmentId": "FBRdhAGblnbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-203740"
}
]
},
"name": "go-testxlang_partition-488",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/17 21:23:28 Submitted job: 2023-05-17_14_23_28-8295848326428429814
2023/05/17 21:23:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-17_14_23_28-8295848326428429814?project=apache-beam-testing
2023/05/17 21:23:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-17_14_23_28-8295848326428429814
2023/05/17 21:23:28 Job state: JOB_STATE_PENDING ...
2023/05/17 21:23:58 Job still running ...
2023/05/17 21:24:28 Job still running ...
2023/05/17 21:24:58 Job still running ...
2023/05/17 21:25:28 Job still running ...
2023/05/17 21:25:58 Job still running ...
2023/05/17 21:26:28 Job still running ...
2023/05/17 21:26:58 Job still running ...
2023/05/17 21:27:29 Job still running ...
2023/05/17 21:27:59 Job still running ...
2023/05/17 21:28:29 Job still running ...
2023/05/17 21:28:59 Job still running ...
2023/05/17 21:29:29 Job still running ...
2023/05/17 21:29:59 Job still running ...
2023/05/17 21:30:29 Job still running ...
2023/05/17 21:30:59 Job still running ...
2023/05/17 21:31:29 Job still running ...
2023/05/17 21:31:59 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-17_14_23_28-8295848326428429814 failed
--- FAIL: TestXLang_Partition (549.97s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3185.107s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684355973980105848
--- FAIL: TestBigQueryIO_BasicWriteRead (11.66s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38157 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EhPdXUaDgs" is_bounded:BOUNDED windowing_strategy_id:"w0@EhPdXUaDgs"}} windowing_strategies:{key:"w0@EhPdXUaDgs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EhPdXUaDgs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EhPdXUaDgs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EhPdXUaDgs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684355973980105848\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EhPdXUaDgs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38157 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EhPdXUaDgs" is_bounded:BOUNDED windowing_strategy_id:"w0@EhPdXUaDgs"}} windowing_strategies:{key:"w0@EhPdXUaDgs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EhPdXUaDgs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EhPdXUaDgs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EhPdXUaDgs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684355973980105848\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EhPdXUaDgs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 14 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc000472300})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc000472300})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000148fe0?, 0xc000181cc0?}, {0x11c9fad, 0x39}, {0xc0001d0180?, 0x10c9600?, 0x1?}, {0xc000501290, 0xf}, 0xc00002bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000148f60?, 0xc000181cc0?}, {0xc000182960, 0x52}, {0x1?}, {0xc00002bea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000501290, 0xf}, {0xc000182960, 0x52}, {0xf25e80, 0xc0001652a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003c8ea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003c8ea0, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 14.853s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.148s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.052s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.106s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-203740
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-203740
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c585e33dcdb287780be410199fd31fa1cc990f65c4bd214676113835e0c2471c
Deleted: sha256:e00a21ff9c1f003a956e8c7614770f9bf2c07b51915d09808f82f2001a2a2edd
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-203740
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c585e33dcdb287780be410199fd31fa1cc990f65c4bd214676113835e0c2471c
Associated tags:
- 20230517-203740
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-203740
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-203740].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c585e33dcdb287780be410199fd31fa1cc990f65c4bd214676113835e0c2471c].
$ rm -rf /tmp/tmp.LKgkBLuT4x
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517202058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae752bb841cf70a6f0c6c17687beae96f7c4a04e3583615bba412c1929c0836
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517202058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae752bb841cf70a6f0c6c17687beae96f7c4a04e3583615bba412c1929c0836]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517202058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae752bb841cf70a6f0c6c17687beae96f7c4a04e3583615bba412c1929c0836])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae752bb841cf70a6f0c6c17687beae96f7c4a04e3583615bba412c1929c0836
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae752bb841cf70a6f0c6c17687beae96f7c4a04e3583615bba412c1929c0836
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae752bb841cf70a6f0c6c17687beae96f7c4a04e3583615bba412c1929c0836].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517202058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f14a093e2ca3e23f647bc964ac1cb53a3aab9b410c5a65ddc285b677417adbbf
Deleted: sha256:e52f40e6b363f65db209f620386dffa408cc53f78647209eb0d58951fe09997d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517202058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f14a093e2ca3e23f647bc964ac1cb53a3aab9b410c5a65ddc285b677417adbbf]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517202058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f14a093e2ca3e23f647bc964ac1cb53a3aab9b410c5a65ddc285b677417adbbf])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f14a093e2ca3e23f647bc964ac1cb53a3aab9b410c5a65ddc285b677417adbbf
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f14a093e2ca3e23f647bc964ac1cb53a3aab9b410c5a65ddc285b677417adbbf
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f14a093e2ca3e23f647bc964ac1cb53a3aab9b410c5a65ddc285b677417adbbf].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3881217.
Stopping expansion service pid: 3881218.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 12m 27s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/z7gcsuk4knara
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1646
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1646/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517142102",
"environmentId": "atRwXsgIGCbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-143805"
}
]
},
"name": "go-testxlang_partition-678",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/17 15:21:21 Submitted job: 2023-05-17_08_21_21-12914410118502779147
2023/05/17 15:21:21 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-17_08_21_21-12914410118502779147?project=apache-beam-testing
2023/05/17 15:21:21 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-17_08_21_21-12914410118502779147
2023/05/17 15:21:21 Job state: JOB_STATE_PENDING ...
2023/05/17 15:21:52 Job still running ...
2023/05/17 15:22:22 Job still running ...
2023/05/17 15:22:52 Job still running ...
2023/05/17 15:23:22 Job still running ...
2023/05/17 15:23:52 Job still running ...
2023/05/17 15:24:22 Job still running ...
2023/05/17 15:24:52 Job still running ...
2023/05/17 15:25:22 Job still running ...
2023/05/17 15:25:52 Job still running ...
2023/05/17 15:26:22 Job still running ...
2023/05/17 15:26:52 Job still running ...
2023/05/17 15:27:22 Job still running ...
2023/05/17 15:27:52 Job still running ...
2023/05/17 15:28:22 Job still running ...
2023/05/17 15:28:52 Job still running ...
2023/05/17 15:29:22 Job still running ...
2023/05/17 15:29:52 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-17_08_21_21-12914410118502779147 failed
--- FAIL: TestXLang_Partition (550.60s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3091.201s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684334342719662576
--- FAIL: TestBigQueryIO_BasicWriteRead (5.64s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39985 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ktshxWCbQA" is_bounded:BOUNDED windowing_strategy_id:"w0@ktshxWCbQA"}} windowing_strategies:{key:"w0@ktshxWCbQA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ktshxWCbQA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ktshxWCbQA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ktshxWCbQA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684334342719662576\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ktshxWCbQA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39985 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ktshxWCbQA" is_bounded:BOUNDED windowing_strategy_id:"w0@ktshxWCbQA"}} windowing_strategies:{key:"w0@ktshxWCbQA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ktshxWCbQA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ktshxWCbQA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ktshxWCbQA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684334342719662576\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ktshxWCbQA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc00040e5c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc00040e5c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005a6fc0?, 0xc0000c0460?}, {0x11c9fa3, 0x39}, {0xc000158180?, 0x10c9600?, 0x1?}, {0xc000489f70, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005a6f40?, 0xc0000c0460?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f70, 0xf}, {0xc00010ec00, 0x52}, {0xf25e80, 0xc0005c92a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031f6c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031f6c0, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.665s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.069s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-143805
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-143805
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:993f35028e7e5780ad50106308ebb424b47d52a39a334d4191eb0f717d85974a
Deleted: sha256:335be74a3eda42bc8e29c648ac8538f1d3aca99374d438c24932a8dc27e7be61
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-143805
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:993f35028e7e5780ad50106308ebb424b47d52a39a334d4191eb0f717d85974a
Associated tags:
- 20230517-143805
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-143805
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-143805].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:993f35028e7e5780ad50106308ebb424b47d52a39a334d4191eb0f717d85974a].
$ rm -rf /tmp/tmp.rC6qkeYn8z
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517142102
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73e3ec5ce17b2817abc3b46ac5297a13daba91dc94170ea290b8aa4df0f7eb96
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517142102]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73e3ec5ce17b2817abc3b46ac5297a13daba91dc94170ea290b8aa4df0f7eb96]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517142102] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73e3ec5ce17b2817abc3b46ac5297a13daba91dc94170ea290b8aa4df0f7eb96])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73e3ec5ce17b2817abc3b46ac5297a13daba91dc94170ea290b8aa4df0f7eb96
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73e3ec5ce17b2817abc3b46ac5297a13daba91dc94170ea290b8aa4df0f7eb96
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73e3ec5ce17b2817abc3b46ac5297a13daba91dc94170ea290b8aa4df0f7eb96].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517142102
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c86e2698641a9356aa7f692d82829a4115485e019073a2c26885ac3abf1b89b4
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517142102]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c86e2698641a9356aa7f692d82829a4115485e019073a2c26885ac3abf1b89b4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517142102] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c86e2698641a9356aa7f692d82829a4115485e019073a2c26885ac3abf1b89b4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c86e2698641a9356aa7f692d82829a4115485e019073a2c26885ac3abf1b89b4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c86e2698641a9356aa7f692d82829a4115485e019073a2c26885ac3abf1b89b4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c86e2698641a9356aa7f692d82829a4115485e019073a2c26885ac3abf1b89b4].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2340904.
Stopping expansion service pid: 2340905.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 6s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/3cp5sf66ewtoi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1645
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1645/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517082052",
"environmentId": "jKPrNGMRRMbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-083413"
}
]
},
"name": "go-testxlang_partition-185",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/17 09:17:21 Submitted job: 2023-05-17_02_17_21-4867816232058340809
2023/05/17 09:17:21 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-17_02_17_21-4867816232058340809?project=apache-beam-testing
2023/05/17 09:17:21 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-17_02_17_21-4867816232058340809
2023/05/17 09:17:21 Job state: JOB_STATE_PENDING ...
2023/05/17 09:17:51 Job still running ...
2023/05/17 09:18:21 Job still running ...
2023/05/17 09:18:51 Job still running ...
2023/05/17 09:19:21 Job still running ...
2023/05/17 09:19:51 Job still running ...
2023/05/17 09:20:21 Job still running ...
2023/05/17 09:20:51 Job still running ...
2023/05/17 09:21:21 Job still running ...
2023/05/17 09:21:51 Job still running ...
2023/05/17 09:22:21 Job still running ...
2023/05/17 09:22:51 Job still running ...
2023/05/17 09:23:21 Job still running ...
2023/05/17 09:23:52 Job still running ...
2023/05/17 09:24:22 Job still running ...
2023/05/17 09:24:52 Job still running ...
2023/05/17 09:25:22 Job still running ...
2023/05/17 09:25:52 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-17_02_17_21-4867816232058340809 failed
--- FAIL: TestXLang_Partition (550.37s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3094.054s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684312491423423602
--- FAIL: TestBigQueryIO_BasicWriteRead (4.49s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45525 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AxUnPHbiYF" is_bounded:BOUNDED windowing_strategy_id:"w0@AxUnPHbiYF"}} windowing_strategies:{key:"w0@AxUnPHbiYF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AxUnPHbiYF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AxUnPHbiYF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AxUnPHbiYF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684312491423423602\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AxUnPHbiYF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45525 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AxUnPHbiYF" is_bounded:BOUNDED windowing_strategy_id:"w0@AxUnPHbiYF"}} windowing_strategies:{key:"w0@AxUnPHbiYF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AxUnPHbiYF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AxUnPHbiYF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AxUnPHbiYF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684312491423423602\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AxUnPHbiYF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc00021e3c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc00021e3c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000718140?, 0xc000594000?}, {0x11c9fa3, 0x39}, {0xc000158180?, 0x10c9600?, 0x41bc91?}, {0xc000489f60, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0007180c0?, 0xc000594000?}, {0xc000050a20, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f60, 0xf}, {0xc000050a20, 0x52}, {0xf25e80, 0xc00073c028})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000582d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000582d00, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.514s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-083413
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-083413
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:22f8974fd3690f085d736f4d870e464feb0291a385f5e94a632ea60f0f932923
Deleted: sha256:215ab1cb8b04012d87c0f26be1b5a871e004494783a51532be6767083c7edd26
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-083413
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:22f8974fd3690f085d736f4d870e464feb0291a385f5e94a632ea60f0f932923
Associated tags:
- 20230517-083413
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-083413
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-083413].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:22f8974fd3690f085d736f4d870e464feb0291a385f5e94a632ea60f0f932923].
$ rm -rf /tmp/tmp.8gGyX4KSXL
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517082052
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e34beba6172ce58087a8f236564c6d8d938a94114a30076dba26e417456dec4b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517082052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e34beba6172ce58087a8f236564c6d8d938a94114a30076dba26e417456dec4b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517082052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e34beba6172ce58087a8f236564c6d8d938a94114a30076dba26e417456dec4b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e34beba6172ce58087a8f236564c6d8d938a94114a30076dba26e417456dec4b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e34beba6172ce58087a8f236564c6d8d938a94114a30076dba26e417456dec4b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e34beba6172ce58087a8f236564c6d8d938a94114a30076dba26e417456dec4b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517082052
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:939161658ed69c09ac2fae3a2d2123a1121437d1a10e8a5d1612b1d8aa20905e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517082052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:939161658ed69c09ac2fae3a2d2123a1121437d1a10e8a5d1612b1d8aa20905e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517082052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:939161658ed69c09ac2fae3a2d2123a1121437d1a10e8a5d1612b1d8aa20905e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:939161658ed69c09ac2fae3a2d2123a1121437d1a10e8a5d1612b1d8aa20905e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:939161658ed69c09ac2fae3a2d2123a1121437d1a10e8a5d1612b1d8aa20905e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:939161658ed69c09ac2fae3a2d2123a1121437d1a10e8a5d1612b1d8aa20905e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3065209.
Stopping expansion service pid: 3065210.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 8s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/62smejnkbm34m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1644
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1644/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517022058",
"environmentId": "NJcidSgPNJbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-023431"
}
]
},
"name": "go-testxlang_partition-908",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/17 03:17:44 Submitted job: 2023-05-16_20_17_43-10079715511856667874
2023/05/17 03:17:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-16_20_17_43-10079715511856667874?project=apache-beam-testing
2023/05/17 03:17:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-16_20_17_43-10079715511856667874
2023/05/17 03:17:44 Job state: JOB_STATE_PENDING ...
2023/05/17 03:18:14 Job still running ...
2023/05/17 03:18:44 Job still running ...
2023/05/17 03:19:14 Job still running ...
2023/05/17 03:19:44 Job still running ...
2023/05/17 03:20:14 Job still running ...
2023/05/17 03:20:44 Job still running ...
2023/05/17 03:21:14 Job still running ...
2023/05/17 03:21:44 Job still running ...
2023/05/17 03:22:14 Job still running ...
2023/05/17 03:22:44 Job still running ...
2023/05/17 03:23:14 Job still running ...
2023/05/17 03:23:44 Job still running ...
2023/05/17 03:24:14 Job still running ...
2023/05/17 03:24:44 Job still running ...
2023/05/17 03:25:14 Job still running ...
2023/05/17 03:25:44 Job still running ...
2023/05/17 03:26:14 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-16_20_17_43-10079715511856667874 failed
--- FAIL: TestXLang_Partition (550.59s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3099.041s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684290913038932864
--- FAIL: TestBigQueryIO_BasicWriteRead (4.34s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44083 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xxpzSkzHVr" is_bounded:BOUNDED windowing_strategy_id:"w0@xxpzSkzHVr"}} windowing_strategies:{key:"w0@xxpzSkzHVr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xxpzSkzHVr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xxpzSkzHVr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xxpzSkzHVr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684290913038932864\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xxpzSkzHVr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44083 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xxpzSkzHVr" is_bounded:BOUNDED windowing_strategy_id:"w0@xxpzSkzHVr"}} windowing_strategies:{key:"w0@xxpzSkzHVr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xxpzSkzHVr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xxpzSkzHVr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xxpzSkzHVr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684290913038932864\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xxpzSkzHVr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xfe1700, 0xc000402bc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1700, 0xc000402bc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005480a0?, 0xc00054a000?}, {0x11c9fa3, 0x39}, {0xc00015a180?, 0x10c9600?, 0x41bc91?}, {0xc000045f50, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000548020?, 0xc00054a000?}, {0xc000050960, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee1260?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc000050960, 0x52}, {0xf25e80, 0xc000132078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031da00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031da00, 0x11fd498)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.371s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.038s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-023431
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-023431
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5f7e3044a713612332837eb174fdead41e7375a58f76c3ba4f965907ebd0170b
Deleted: sha256:c3303930de60f0169934a608b80ba72402fa935105664ef8b282524032cfdc21
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-023431
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5f7e3044a713612332837eb174fdead41e7375a58f76c3ba4f965907ebd0170b
Associated tags:
- 20230517-023431
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-023431
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230517-023431].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5f7e3044a713612332837eb174fdead41e7375a58f76c3ba4f965907ebd0170b].
$ rm -rf /tmp/tmp.8S8vIWGwRs
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517022058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a62a8267e4ec696e98691f21acb4c7c1fe80c184c745c877ed49771deecd2d0a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517022058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a62a8267e4ec696e98691f21acb4c7c1fe80c184c745c877ed49771deecd2d0a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517022058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a62a8267e4ec696e98691f21acb4c7c1fe80c184c745c877ed49771deecd2d0a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a62a8267e4ec696e98691f21acb4c7c1fe80c184c745c877ed49771deecd2d0a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a62a8267e4ec696e98691f21acb4c7c1fe80c184c745c877ed49771deecd2d0a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a62a8267e4ec696e98691f21acb4c7c1fe80c184c745c877ed49771deecd2d0a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517022058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:031db863bd477ca7daac45de6965fa7033aa55a5c4a33e6e2bce1e6df126f551
Deleted: sha256:02b2e5cc586c55c0aabfbf8097cb6168326cd777c64a62347edf7600ec04677d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517022058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:031db863bd477ca7daac45de6965fa7033aa55a5c4a33e6e2bce1e6df126f551]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517022058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:031db863bd477ca7daac45de6965fa7033aa55a5c4a33e6e2bce1e6df126f551])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:031db863bd477ca7daac45de6965fa7033aa55a5c4a33e6e2bce1e6df126f551
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:031db863bd477ca7daac45de6965fa7033aa55a5c4a33e6e2bce1e6df126f551
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:031db863bd477ca7daac45de6965fa7033aa55a5c4a33e6e2bce1e6df126f551].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2814244.
Stopping expansion service pid: 2814245.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 31s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/ukzb3qscldc7g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1643
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1643/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516202058",
"environmentId": "vKeoLLTEigbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-203500"
}
]
},
"name": "go-testxlang_partition-269",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/16 21:18:53 Submitted job: 2023-05-16_14_18_53-15761006595697760624
2023/05/16 21:18:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-16_14_18_53-15761006595697760624?project=apache-beam-testing
2023/05/16 21:18:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-16_14_18_53-15761006595697760624
2023/05/16 21:18:53 Job state: JOB_STATE_PENDING ...
2023/05/16 21:19:23 Job still running ...
2023/05/16 21:19:53 Job still running ...
2023/05/16 21:20:23 Job still running ...
2023/05/16 21:20:53 Job still running ...
2023/05/16 21:21:24 Job still running ...
2023/05/16 21:21:54 Job still running ...
2023/05/16 21:22:24 Job still running ...
2023/05/16 21:22:54 Job still running ...
2023/05/16 21:23:24 Job still running ...
2023/05/16 21:23:54 Job still running ...
2023/05/16 21:24:24 Job still running ...
2023/05/16 21:24:54 Job still running ...
2023/05/16 21:25:24 Job still running ...
2023/05/16 21:25:54 Job still running ...
2023/05/16 21:26:24 Job still running ...
2023/05/16 21:26:54 Job still running ...
2023/05/16 21:27:24 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-16_14_18_53-15761006595697760624 failed
--- FAIL: TestXLang_Partition (557.25s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3125.388s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684269357595018456
--- FAIL: TestBigQueryIO_BasicWriteRead (6.16s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35745 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WsJLNvNLDS" is_bounded:BOUNDED windowing_strategy_id:"w0@WsJLNvNLDS"}} windowing_strategies:{key:"w0@WsJLNvNLDS" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WsJLNvNLDS" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WsJLNvNLDS" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WsJLNvNLDS" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684269357595018456\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WsJLNvNLDS"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35745 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WsJLNvNLDS" is_bounded:BOUNDED windowing_strategy_id:"w0@WsJLNvNLDS"}} windowing_strategies:{key:"w0@WsJLNvNLDS" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WsJLNvNLDS" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WsJLNvNLDS" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WsJLNvNLDS" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684269357595018456\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WsJLNvNLDS"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe1540, 0xc0003123c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1540, 0xc0003123c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aaa00?, 0xc000135f90?}, {0x11c9ad9, 0x39}, {0xc0000f4180?, 0x10c9300?, 0x41bc91?}, {0xc00012bd80, 0xf}, 0xc000567d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aa840?, 0xc000135f90?}, {0xc00014a7e0, 0x52}, {0x1?}, {0xc000567ea8, 0x2, 0xee1100?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00012bd80, 0xf}, {0xc00014a7e0, 0x52}, {0xf25d20, 0xc00046d1c0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2b60, 0x11fcff8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.190s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.054s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-203500
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-203500
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cd82312011239e5dcb08facc102ac819e85ca33147789fa72b7fd3d8b58c9eee
Deleted: sha256:4d4be0bb7bcdd93600a79dcc1f9da175007259424ef452632f89d1d2987074db
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-203500
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cd82312011239e5dcb08facc102ac819e85ca33147789fa72b7fd3d8b58c9eee
Associated tags:
- 20230516-203500
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-203500
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-203500].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cd82312011239e5dcb08facc102ac819e85ca33147789fa72b7fd3d8b58c9eee].
$ rm -rf /tmp/tmp.P0acQTnQZ7
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516202058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:994c1ba40ddbcecb11fea7e66ef19e7b1c707ac7fd0278270e7a2e9f861bfb02
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516202058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:994c1ba40ddbcecb11fea7e66ef19e7b1c707ac7fd0278270e7a2e9f861bfb02]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516202058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:994c1ba40ddbcecb11fea7e66ef19e7b1c707ac7fd0278270e7a2e9f861bfb02])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:994c1ba40ddbcecb11fea7e66ef19e7b1c707ac7fd0278270e7a2e9f861bfb02
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:994c1ba40ddbcecb11fea7e66ef19e7b1c707ac7fd0278270e7a2e9f861bfb02
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:994c1ba40ddbcecb11fea7e66ef19e7b1c707ac7fd0278270e7a2e9f861bfb02].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516202058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4d963277e5bee8d77bdc73445c725f2761965cbb11226992043f7897597c10
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516202058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4d963277e5bee8d77bdc73445c725f2761965cbb11226992043f7897597c10]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516202058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4d963277e5bee8d77bdc73445c725f2761965cbb11226992043f7897597c10])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4d963277e5bee8d77bdc73445c725f2761965cbb11226992043f7897597c10
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4d963277e5bee8d77bdc73445c725f2761965cbb11226992043f7897597c10
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2c4d963277e5bee8d77bdc73445c725f2761965cbb11226992043f7897597c10].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2593003.
Stopping expansion service pid: 2593004.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 40s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/k7rp3ko5n6tpq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1642
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1642/display/redirect?page=changes>
Changes:
[noreply] Improve ValueError message in Deduplicate (#26665)
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516142659",
"environmentId": "hfRPQHNETObeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-144129"
}
]
},
"name": "go-testxlang_partition-397",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/16 15:24:58 Submitted job: 2023-05-16_08_24_57-6166178037278554819
2023/05/16 15:24:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-16_08_24_57-6166178037278554819?project=apache-beam-testing
2023/05/16 15:24:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-16_08_24_57-6166178037278554819
2023/05/16 15:24:58 Job state: JOB_STATE_PENDING ...
2023/05/16 15:25:28 Job still running ...
2023/05/16 15:25:58 Job still running ...
2023/05/16 15:26:28 Job still running ...
2023/05/16 15:26:58 Job still running ...
2023/05/16 15:27:28 Job still running ...
2023/05/16 15:27:58 Job still running ...
2023/05/16 15:28:28 Job still running ...
2023/05/16 15:28:58 Job still running ...
2023/05/16 15:29:28 Job still running ...
2023/05/16 15:29:58 Job still running ...
2023/05/16 15:30:28 Job still running ...
2023/05/16 15:30:58 Job still running ...
2023/05/16 15:31:28 Job still running ...
2023/05/16 15:31:58 Job still running ...
2023/05/16 15:32:28 Job still running ...
2023/05/16 15:32:58 Job still running ...
2023/05/16 15:33:29 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-16_08_24_57-6166178037278554819 failed
--- FAIL: TestXLang_Partition (550.14s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3106.967s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684248141774100621
--- FAIL: TestBigQueryIO_BasicWriteRead (7.14s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44687 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lCdbQsKnnF" is_bounded:BOUNDED windowing_strategy_id:"w0@lCdbQsKnnF"}} windowing_strategies:{key:"w0@lCdbQsKnnF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lCdbQsKnnF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lCdbQsKnnF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lCdbQsKnnF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684248141774100621\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lCdbQsKnnF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44687 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lCdbQsKnnF" is_bounded:BOUNDED windowing_strategy_id:"w0@lCdbQsKnnF"}} windowing_strategies:{key:"w0@lCdbQsKnnF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lCdbQsKnnF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lCdbQsKnnF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lCdbQsKnnF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684248141774100621\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lCdbQsKnnF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0005f8900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0005f8900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aa1e0?, 0xc0006d8000?}, {0x11c9c19, 0x39}, {0xc0000f4180?, 0x10c9440?, 0x41bc91?}, {0xc00046be80, 0xf}, 0xc0000f1d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aa040?, 0xc0006d8000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc0000f1ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046be80, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2b60, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 10.170s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.062s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-144129
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-144129
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:05758efac37d7859f505544fec999b7871e7f715924320caface69e3b0eaa27f
Deleted: sha256:e0d3efb18a0f9d89292e8d18cf922b5fde4252f4ec1d383f609faad48d695e62
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-144129
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:05758efac37d7859f505544fec999b7871e7f715924320caface69e3b0eaa27f
Associated tags:
- 20230516-144129
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-144129
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-144129].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:05758efac37d7859f505544fec999b7871e7f715924320caface69e3b0eaa27f].
$ rm -rf /tmp/tmp.v1Xd7CpHLs
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516142659
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:76eb7ba1a6c4b469cc7df65b46e8db21d229d34c26b236d5909d7f32dc686bd1
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516142659]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:76eb7ba1a6c4b469cc7df65b46e8db21d229d34c26b236d5909d7f32dc686bd1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516142659] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:76eb7ba1a6c4b469cc7df65b46e8db21d229d34c26b236d5909d7f32dc686bd1])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:76eb7ba1a6c4b469cc7df65b46e8db21d229d34c26b236d5909d7f32dc686bd1
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:76eb7ba1a6c4b469cc7df65b46e8db21d229d34c26b236d5909d7f32dc686bd1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:76eb7ba1a6c4b469cc7df65b46e8db21d229d34c26b236d5909d7f32dc686bd1].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516142659
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0455940764275daaa7a9c544624f75a24e82ac28b0bfd91288e53ea9ea2899bb
Deleted: sha256:e1e5a6a620e019d6b8a184851bf5703d4329e94e5d6127d2060ac0c5125ab560
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516142659]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0455940764275daaa7a9c544624f75a24e82ac28b0bfd91288e53ea9ea2899bb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516142659] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0455940764275daaa7a9c544624f75a24e82ac28b0bfd91288e53ea9ea2899bb])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0455940764275daaa7a9c544624f75a24e82ac28b0bfd91288e53ea9ea2899bb
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0455940764275daaa7a9c544624f75a24e82ac28b0bfd91288e53ea9ea2899bb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0455940764275daaa7a9c544624f75a24e82ac28b0bfd91288e53ea9ea2899bb].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2072822.
Stopping expansion service pid: 2072823.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 44s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/kk5up4lgevmxe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1641
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1641/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-115347",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516113717",
"environmentId": "IvKHcbHSXQbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-115347"
}
]
},
"name": "go-testxlang_partition-592",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/16 12:37:59 Submitted job: 2023-05-16_05_37_58-13112620687898235296
2023/05/16 12:37:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-16_05_37_58-13112620687898235296?project=apache-beam-testing
2023/05/16 12:37:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-16_05_37_58-13112620687898235296
2023/05/16 12:37:59 Job state: JOB_STATE_PENDING ...
2023/05/16 12:38:29 Job still running ...
2023/05/16 12:38:59 Job still running ...
2023/05/16 12:39:29 Job still running ...
2023/05/16 12:39:59 Job still running ...
2023/05/16 12:40:29 Job still running ...
2023/05/16 12:40:59 Job still running ...
2023/05/16 12:41:29 Job still running ...
2023/05/16 12:41:59 Job still running ...
2023/05/16 12:42:29 Job still running ...
2023/05/16 12:42:59 Job still running ...
2023/05/16 12:43:29 Job still running ...
2023/05/16 12:43:59 Job still running ...
2023/05/16 12:44:29 Job still running ...
2023/05/16 12:44:59 Job still running ...
2023/05/16 12:45:29 Job still running ...
2023/05/16 12:45:59 Job still running ...
2023/05/16 12:46:29 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-16_05_37_58-13112620687898235296 failed
--- FAIL: TestXLang_Partition (553.00s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3151.577s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684238078327175103
--- FAIL: TestBigQueryIO_BasicWriteRead (6.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36015 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ieUydtLfEp" is_bounded:BOUNDED windowing_strategy_id:"w0@ieUydtLfEp"}} windowing_strategies:{key:"w0@ieUydtLfEp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ieUydtLfEp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ieUydtLfEp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ieUydtLfEp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684238078327175103\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ieUydtLfEp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36015 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ieUydtLfEp" is_bounded:BOUNDED windowing_strategy_id:"w0@ieUydtLfEp"}} windowing_strategies:{key:"w0@ieUydtLfEp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ieUydtLfEp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ieUydtLfEp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ieUydtLfEp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684238078327175103\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ieUydtLfEp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 15 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00020ab40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00020ab40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006d6140?, 0xc000126000?}, {0x11c9c19, 0x39}, {0xc0000f4180?, 0x10c9440?, 0x41bc91?}, {0xc00046dbf0, 0xf}, 0xc00057dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006d60c0?, 0xc000126000?}, {0xc000050d20, 0x52}, {0x1?}, {0xc00057dea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dbf0, 0xf}, {0xc000050d20, 0x52}, {0xf25d40, 0xc0006d82a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103520, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.470s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.181s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:292be5c28cfaa3e3c567b060894ccf0e9acdc5cbc5d950e6670687f87016423b
Associated tags:
- 20230516-115347
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-115347
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-115347].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:292be5c28cfaa3e3c567b060894ccf0e9acdc5cbc5d950e6670687f87016423b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516113717]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11a2b9b28db4554b35188c9ee5bd53d35ef0e5ed03e74b003936e1380d2765c6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516113717] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11a2b9b28db4554b35188c9ee5bd53d35ef0e5ed03e74b003936e1380d2765c6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11a2b9b28db4554b35188c9ee5bd53d35ef0e5ed03e74b003936e1380d2765c6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11a2b9b28db4554b35188c9ee5bd53d35ef0e5ed03e74b003936e1380d2765c6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516113717]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:625e6854753b0df74461d1058da42a2b851d86e18228f5695df29d8105d3687a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516113717] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:625e6854753b0df74461d1058da42a2b851d86e18228f5695df29d8105d3687a])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:625e6854753b0df74461d1058da42a2b851d86e18228f5695df29d8105d3687a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:625e6854753b0df74461d1058da42a2b851d86e18228f5695df29d8105d3687a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 32s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/rb4lzrkeagmxy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1640
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1640/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516022058",
"environmentId": "gWfwwmmjLRbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-023455"
}
]
},
"name": "go-testxlang_partition-141",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/16 03:17:28 Submitted job: 2023-05-15_20_17_27-1779153131484005892
2023/05/16 03:17:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-15_20_17_27-1779153131484005892?project=apache-beam-testing
2023/05/16 03:17:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-15_20_17_27-1779153131484005892
2023/05/16 03:17:28 Job state: JOB_STATE_PENDING ...
2023/05/16 03:17:58 Job still running ...
2023/05/16 03:18:28 Job still running ...
2023/05/16 03:18:58 Job still running ...
2023/05/16 03:19:28 Job still running ...
2023/05/16 03:19:58 Job still running ...
2023/05/16 03:20:28 Job still running ...
2023/05/16 03:20:58 Job still running ...
2023/05/16 03:21:28 Job still running ...
2023/05/16 03:21:58 Job still running ...
2023/05/16 03:22:28 Job still running ...
2023/05/16 03:22:58 Job still running ...
2023/05/16 03:23:28 Job still running ...
2023/05/16 03:23:58 Job still running ...
2023/05/16 03:24:28 Job still running ...
2023/05/16 03:24:58 Job still running ...
2023/05/16 03:25:29 Job still running ...
2023/05/16 03:25:59 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-15_20_17_27-1779153131484005892 failed
--- FAIL: TestXLang_Partition (551.54s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3058.237s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684204540464742059
--- FAIL: TestBigQueryIO_BasicWriteRead (4.51s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46163 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tLmoGXpUFW" is_bounded:BOUNDED windowing_strategy_id:"w0@tLmoGXpUFW"}} windowing_strategies:{key:"w0@tLmoGXpUFW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tLmoGXpUFW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tLmoGXpUFW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tLmoGXpUFW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684204540464742059\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tLmoGXpUFW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46163 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tLmoGXpUFW" is_bounded:BOUNDED windowing_strategy_id:"w0@tLmoGXpUFW"}} windowing_strategies:{key:"w0@tLmoGXpUFW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tLmoGXpUFW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tLmoGXpUFW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tLmoGXpUFW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684204540464742059\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tLmoGXpUFW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00027a900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00027a900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006280a0?, 0xc00062c000?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00046def0, 0xf}, 0xc000205d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000628020?, 0xc00062c000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc000205ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046def0, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc00062a008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103ba0, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.533s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.039s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-023455
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-023455
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:61b2ba1e343d89239c5a8d5f108bac1a5c00ad21a0d8ea88bfc32bc7865e2576
Deleted: sha256:10a7fb8ec76b83b5027f41704ed2e783387afe6db47509fbfac5cefae327fe73
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-023455
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:61b2ba1e343d89239c5a8d5f108bac1a5c00ad21a0d8ea88bfc32bc7865e2576
Associated tags:
- 20230516-023455
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-023455
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230516-023455].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:61b2ba1e343d89239c5a8d5f108bac1a5c00ad21a0d8ea88bfc32bc7865e2576].
$ rm -rf /tmp/tmp.QD0vekSh72
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516022058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c818e022011b33dbc298a61cd41e165006c37ea400f189407507598d9871e57a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516022058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c818e022011b33dbc298a61cd41e165006c37ea400f189407507598d9871e57a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230516022058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c818e022011b33dbc298a61cd41e165006c37ea400f189407507598d9871e57a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c818e022011b33dbc298a61cd41e165006c37ea400f189407507598d9871e57a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c818e022011b33dbc298a61cd41e165006c37ea400f189407507598d9871e57a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c818e022011b33dbc298a61cd41e165006c37ea400f189407507598d9871e57a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516022058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ca819501f05f5e0b710190dbe9b6f150a06d1bedb46b0136d5dfddb1a988e30
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516022058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ca819501f05f5e0b710190dbe9b6f150a06d1bedb46b0136d5dfddb1a988e30]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230516022058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ca819501f05f5e0b710190dbe9b6f150a06d1bedb46b0136d5dfddb1a988e30])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ca819501f05f5e0b710190dbe9b6f150a06d1bedb46b0136d5dfddb1a988e30
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ca819501f05f5e0b710190dbe9b6f150a06d1bedb46b0136d5dfddb1a988e30
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ca819501f05f5e0b710190dbe9b6f150a06d1bedb46b0136d5dfddb1a988e30].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1165089.
Stopping expansion service pid: 1165090.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 14s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/l7kry6rcjz4ga
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1639
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1639/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-203314",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515202040",
"environmentId": "xYgaNwgkzQbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-203314"
}
]
},
"name": "go-testxlang_partition-902",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/15 21:16:23 Submitted job: 2023-05-15_14_16_22-16399419617912448358
2023/05/15 21:16:23 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-15_14_16_22-16399419617912448358?project=apache-beam-testing
2023/05/15 21:16:23 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-15_14_16_22-16399419617912448358
2023/05/15 21:16:23 Job state: JOB_STATE_PENDING ...
2023/05/15 21:16:53 Job still running ...
2023/05/15 21:17:23 Job still running ...
2023/05/15 21:17:53 Job still running ...
2023/05/15 21:18:23 Job still running ...
2023/05/15 21:18:53 Job still running ...
2023/05/15 21:19:23 Job still running ...
2023/05/15 21:19:53 Job still running ...
2023/05/15 21:20:23 Job still running ...
2023/05/15 21:20:53 Job still running ...
2023/05/15 21:21:23 Job still running ...
2023/05/15 21:21:53 Job still running ...
2023/05/15 21:22:23 Job still running ...
2023/05/15 21:22:53 Job still running ...
2023/05/15 21:23:23 Job still running ...
2023/05/15 21:23:53 Job still running ...
2023/05/15 21:24:23 Job still running ...
2023/05/15 21:24:53 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-15_14_16_22-16399419617912448358 failed
--- FAIL: TestXLang_Partition (550.30s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3091.037s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684182836395213264
--- FAIL: TestBigQueryIO_BasicWriteRead (4.71s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43369 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aRcMJfnZAq" is_bounded:BOUNDED windowing_strategy_id:"w0@aRcMJfnZAq"}} windowing_strategies:{key:"w0@aRcMJfnZAq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aRcMJfnZAq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aRcMJfnZAq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aRcMJfnZAq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684182836395213264\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aRcMJfnZAq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43369 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aRcMJfnZAq" is_bounded:BOUNDED windowing_strategy_id:"w0@aRcMJfnZAq"}} windowing_strategies:{key:"w0@aRcMJfnZAq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aRcMJfnZAq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aRcMJfnZAq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aRcMJfnZAq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684182836395213264\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aRcMJfnZAq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00021e340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00021e340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aea00?, 0xc00015bf90?}, {0x11c9c19, 0x39}, {0xc0000f6240?, 0x10c9440?, 0x1?}, {0xc00014bd70, 0xf}, 0xc000575d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae840?, 0xc00015bf90?}, {0xc000050f00, 0x52}, {0x1?}, {0xc000575ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00014bd70, 0xf}, {0xc000050f00, 0x52}, {0xf25d40, 0xc00046d1b0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2d00, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.740s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4f6f9148f070f0f68349eba9251d93828fcbcaf728b729e74f58650ca177f192
Associated tags:
- 20230515-203314
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-203314
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-203314].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4f6f9148f070f0f68349eba9251d93828fcbcaf728b729e74f58650ca177f192].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53d99de63fba2e4198a7b3129e6830bd2d2d0877a00c66c0145ee0c75aa41d5c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53d99de63fba2e4198a7b3129e6830bd2d2d0877a00c66c0145ee0c75aa41d5c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53d99de63fba2e4198a7b3129e6830bd2d2d0877a00c66c0145ee0c75aa41d5c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53d99de63fba2e4198a7b3129e6830bd2d2d0877a00c66c0145ee0c75aa41d5c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3079a09becaec6bb1397639ecc2cda124f9018e2883fa7313656eb61cae86ae3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3079a09becaec6bb1397639ecc2cda124f9018e2883fa7313656eb61cae86ae3])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3079a09becaec6bb1397639ecc2cda124f9018e2883fa7313656eb61cae86ae3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3079a09becaec6bb1397639ecc2cda124f9018e2883fa7313656eb61cae86ae3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 22s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/lwye2u6gi4bpi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1638
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1638/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-143617",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515142057",
"environmentId": "dgrfFIuUBubeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-143617"
}
]
},
"name": "go-testxlang_partition-520",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/15 15:18:36 Submitted job: 2023-05-15_08_18_36-13906573598584619544
2023/05/15 15:18:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-15_08_18_36-13906573598584619544?project=apache-beam-testing
2023/05/15 15:18:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-15_08_18_36-13906573598584619544
2023/05/15 15:18:36 Job state: JOB_STATE_PENDING ...
2023/05/15 15:19:06 Job still running ...
2023/05/15 15:19:36 Job still running ...
2023/05/15 15:20:06 Job still running ...
2023/05/15 15:20:36 Job still running ...
2023/05/15 15:21:06 Job still running ...
2023/05/15 15:21:36 Job still running ...
2023/05/15 15:22:06 Job still running ...
2023/05/15 15:22:36 Job still running ...
2023/05/15 15:23:07 Job still running ...
2023/05/15 15:23:37 Job still running ...
2023/05/15 15:24:07 Job still running ...
2023/05/15 15:24:37 Job still running ...
2023/05/15 15:25:07 Job still running ...
2023/05/15 15:25:37 Job still running ...
2023/05/15 15:26:07 Job still running ...
2023/05/15 15:26:37 Job still running ...
2023/05/15 15:27:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-15_08_18_36-13906573598584619544 failed
--- FAIL: TestXLang_Partition (550.88s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3037.535s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684161431080051690
--- FAIL: TestBigQueryIO_BasicWriteRead (7.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34083 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LUuwwjYYxi" is_bounded:BOUNDED windowing_strategy_id:"w0@LUuwwjYYxi"}} windowing_strategies:{key:"w0@LUuwwjYYxi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LUuwwjYYxi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LUuwwjYYxi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LUuwwjYYxi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684161431080051690\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LUuwwjYYxi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34083 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LUuwwjYYxi" is_bounded:BOUNDED windowing_strategy_id:"w0@LUuwwjYYxi"}} windowing_strategies:{key:"w0@LUuwwjYYxi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LUuwwjYYxi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LUuwwjYYxi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LUuwwjYYxi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684161431080051690\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LUuwwjYYxi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00066c4c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00066c4c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001440a0?, 0xc000146000?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00046de80, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000144020?, 0xc000146000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de80, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc000700018})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 10.358s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.037s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:02496faa58b7fff3f2d191273852ec90690db4a151a60f8de6233f24e31e6b1f
Associated tags:
- 20230515-143617
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-143617
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-143617].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:02496faa58b7fff3f2d191273852ec90690db4a151a60f8de6233f24e31e6b1f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515142057]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da72ddf22718f730cc974b13baa4daf0b75fadf93764e8c68323a2267472d45c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515142057] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da72ddf22718f730cc974b13baa4daf0b75fadf93764e8c68323a2267472d45c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da72ddf22718f730cc974b13baa4daf0b75fadf93764e8c68323a2267472d45c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da72ddf22718f730cc974b13baa4daf0b75fadf93764e8c68323a2267472d45c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515142057]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a22cbb216d85dded4c272dcae16d41426ec131568bc7639831b32ca736c17d6e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515142057] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a22cbb216d85dded4c272dcae16d41426ec131568bc7639831b32ca736c17d6e])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a22cbb216d85dded4c272dcae16d41426ec131568bc7639831b32ca736c17d6e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a22cbb216d85dded4c272dcae16d41426ec131568bc7639831b32ca736c17d6e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 25s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/546puj4hz5njo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1637
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1637/display/redirect?page=changes>
Changes:
[noreply] Support configuration of maxCapacityPerShard when reading from Kinesis
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515082051",
"environmentId": "vDoWwhRGpobeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-083423"
}
]
},
"name": "go-testxlang_partition-575",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/15 09:17:52 Submitted job: 2023-05-15_02_17_52-6460343482121118633
2023/05/15 09:17:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-15_02_17_52-6460343482121118633?project=apache-beam-testing
2023/05/15 09:17:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-15_02_17_52-6460343482121118633
2023/05/15 09:17:52 Job state: JOB_STATE_PENDING ...
2023/05/15 09:18:22 Job still running ...
2023/05/15 09:18:52 Job still running ...
2023/05/15 09:19:23 Job still running ...
2023/05/15 09:19:53 Job still running ...
2023/05/15 09:20:23 Job still running ...
2023/05/15 09:20:53 Job still running ...
2023/05/15 09:21:23 Job still running ...
2023/05/15 09:21:53 Job still running ...
2023/05/15 09:22:23 Job still running ...
2023/05/15 09:22:53 Job still running ...
2023/05/15 09:23:23 Job still running ...
2023/05/15 09:23:53 Job still running ...
2023/05/15 09:24:23 Job still running ...
2023/05/15 09:24:53 Job still running ...
2023/05/15 09:25:23 Job still running ...
2023/05/15 09:25:53 Job still running ...
2023/05/15 09:26:23 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-15_02_17_52-6460343482121118633 failed
--- FAIL: TestXLang_Partition (550.32s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3118.344s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684139698571442412
--- FAIL: TestBigQueryIO_BasicWriteRead (4.71s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34145 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sENpGGjLsV" is_bounded:BOUNDED windowing_strategy_id:"w0@sENpGGjLsV"}} windowing_strategies:{key:"w0@sENpGGjLsV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sENpGGjLsV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sENpGGjLsV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sENpGGjLsV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684139698571442412\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sENpGGjLsV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34145 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sENpGGjLsV" is_bounded:BOUNDED windowing_strategy_id:"w0@sENpGGjLsV"}} windowing_strategies:{key:"w0@sENpGGjLsV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sENpGGjLsV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sENpGGjLsV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sENpGGjLsV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684139698571442412\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sENpGGjLsV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0002bcd00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0002bcd00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae0c0?, 0xc0000f43c0?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x1?}, {0xc00046def0, 0xf}, 0xc000205d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010ffc0?, 0xc0000f43c0?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc000205ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046def0, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc000045ae0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000102ea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000102ea0, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.735s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-083423
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-083423
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b0023478eb0b22e7388cebc171dcd402fb43134b39bb9a6bd57cb8ae7cf76b87
Deleted: sha256:e912176794a5c2bdcb6af7eac9345f6478c189977e2345afccfe6b63d92c01ec
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-083423
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b0023478eb0b22e7388cebc171dcd402fb43134b39bb9a6bd57cb8ae7cf76b87
Associated tags:
- 20230515-083423
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-083423
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-083423].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b0023478eb0b22e7388cebc171dcd402fb43134b39bb9a6bd57cb8ae7cf76b87].
$ rm -rf /tmp/tmp.B5VAvObhhU
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515082051
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46667d2f2a5f3dc11d587beb749f7ef44da381c5e132c2cf2864c6478f357d7c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515082051]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46667d2f2a5f3dc11d587beb749f7ef44da381c5e132c2cf2864c6478f357d7c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515082051] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46667d2f2a5f3dc11d587beb749f7ef44da381c5e132c2cf2864c6478f357d7c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46667d2f2a5f3dc11d587beb749f7ef44da381c5e132c2cf2864c6478f357d7c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46667d2f2a5f3dc11d587beb749f7ef44da381c5e132c2cf2864c6478f357d7c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46667d2f2a5f3dc11d587beb749f7ef44da381c5e132c2cf2864c6478f357d7c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515082051
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7c3e92fd3701b3329f0fee04c1674cbb8f3d34da2ca7e73668b6817bb825a3f3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515082051]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7c3e92fd3701b3329f0fee04c1674cbb8f3d34da2ca7e73668b6817bb825a3f3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515082051] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7c3e92fd3701b3329f0fee04c1674cbb8f3d34da2ca7e73668b6817bb825a3f3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7c3e92fd3701b3329f0fee04c1674cbb8f3d34da2ca7e73668b6817bb825a3f3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7c3e92fd3701b3329f0fee04c1674cbb8f3d34da2ca7e73668b6817bb825a3f3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7c3e92fd3701b3329f0fee04c1674cbb8f3d34da2ca7e73668b6817bb825a3f3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3334699.
Stopping expansion service pid: 3334700.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 40s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/nduo7ss4ph3hs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1636
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1636/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-023531",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515022053",
"environmentId": "wKPKcDMYafbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-023531"
}
]
},
"name": "go-testxlang_partition-329",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/15 03:18:02 Submitted job: 2023-05-14_20_18_01-16737573161271547823
2023/05/15 03:18:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-14_20_18_01-16737573161271547823?project=apache-beam-testing
2023/05/15 03:18:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-14_20_18_01-16737573161271547823
2023/05/15 03:18:02 Job state: JOB_STATE_PENDING ...
2023/05/15 03:18:32 Job still running ...
2023/05/15 03:19:02 Job still running ...
2023/05/15 03:19:32 Job still running ...
2023/05/15 03:20:02 Job still running ...
2023/05/15 03:20:32 Job still running ...
2023/05/15 03:21:02 Job still running ...
2023/05/15 03:21:32 Job still running ...
2023/05/15 03:22:02 Job still running ...
2023/05/15 03:22:32 Job still running ...
2023/05/15 03:23:02 Job still running ...
2023/05/15 03:23:32 Job still running ...
2023/05/15 03:24:02 Job still running ...
2023/05/15 03:24:32 Job still running ...
2023/05/15 03:25:02 Job still running ...
2023/05/15 03:25:32 Job still running ...
2023/05/15 03:26:02 Job still running ...
2023/05/15 03:26:32 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-14_20_18_01-16737573161271547823 failed
--- FAIL: TestXLang_Partition (549.58s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3057.747s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684118168262781299
--- FAIL: TestBigQueryIO_BasicWriteRead (4.56s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42071 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tlPKlHessx" is_bounded:BOUNDED windowing_strategy_id:"w0@tlPKlHessx"}} windowing_strategies:{key:"w0@tlPKlHessx" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tlPKlHessx" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tlPKlHessx" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tlPKlHessx" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684118168262781299\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tlPKlHessx"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42071 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tlPKlHessx" is_bounded:BOUNDED windowing_strategy_id:"w0@tlPKlHessx"}} windowing_strategies:{key:"w0@tlPKlHessx" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tlPKlHessx" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tlPKlHessx" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tlPKlHessx" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684118168262781299\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tlPKlHessx"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0002ac500})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0002ac500})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0007000c0?, 0xc000690050?}, {0x11c9c19, 0x39}, {0xc000158180?, 0x10c9440?, 0x41bc91?}, {0xc000045f40, 0xf}, 0xc0002d9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000700040?, 0xc000690050?}, {0xc000050960, 0x52}, {0x1?}, {0xc0002d9ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc000050960, 0x52}, {0xf25d40, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006431e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006431e0, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.589s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:07e26d08acd0d17f7c8d3fbcc5759a83d07d94a097cbf7e6fcb420d21007c123
Associated tags:
- 20230515-023531
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-023531
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230515-023531].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:07e26d08acd0d17f7c8d3fbcc5759a83d07d94a097cbf7e6fcb420d21007c123].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515022053]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d28f7e4e4b31c201c6d656ac14e4cea9343de119adf596bc2856f01cbe89a2b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230515022053] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d28f7e4e4b31c201c6d656ac14e4cea9343de119adf596bc2856f01cbe89a2b])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d28f7e4e4b31c201c6d656ac14e4cea9343de119adf596bc2856f01cbe89a2b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d28f7e4e4b31c201c6d656ac14e4cea9343de119adf596bc2856f01cbe89a2b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515022053]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:26832a726184e788e168a2a9aebe095d5da7259d61bf4ae318e06b37fb533a03]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230515022053] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:26832a726184e788e168a2a9aebe095d5da7259d61bf4ae318e06b37fb533a03])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:26832a726184e788e168a2a9aebe095d5da7259d61bf4ae318e06b37fb533a03
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:26832a726184e788e168a2a9aebe095d5da7259d61bf4ae318e06b37fb533a03].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 49s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/xek5zad4u5n56
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1635
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1635/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514202050",
"environmentId": "lIMXaEkOxmbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-203354"
}
]
},
"name": "go-testxlang_partition-22",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/14 21:16:20 Submitted job: 2023-05-14_14_16_20-13312370120393879909
2023/05/14 21:16:20 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-14_14_16_20-13312370120393879909?project=apache-beam-testing
2023/05/14 21:16:20 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-14_14_16_20-13312370120393879909
2023/05/14 21:16:20 Job state: JOB_STATE_PENDING ...
2023/05/14 21:16:50 Job still running ...
2023/05/14 21:17:20 Job still running ...
2023/05/14 21:17:50 Job still running ...
2023/05/14 21:18:20 Job still running ...
2023/05/14 21:18:50 Job still running ...
2023/05/14 21:19:21 Job still running ...
2023/05/14 21:19:51 Job still running ...
2023/05/14 21:20:21 Job still running ...
2023/05/14 21:20:51 Job still running ...
2023/05/14 21:21:21 Job still running ...
2023/05/14 21:21:51 Job still running ...
2023/05/14 21:22:21 Job still running ...
2023/05/14 21:22:51 Job still running ...
2023/05/14 21:23:21 Job still running ...
2023/05/14 21:23:51 Job still running ...
2023/05/14 21:24:21 Job still running ...
2023/05/14 21:24:51 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-14_14_16_20-13312370120393879909 failed
--- FAIL: TestXLang_Partition (550.60s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3056.209s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684096468418749424
--- FAIL: TestBigQueryIO_BasicWriteRead (4.39s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45931 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PsdhoXtmXt" is_bounded:BOUNDED windowing_strategy_id:"w0@PsdhoXtmXt"}} windowing_strategies:{key:"w0@PsdhoXtmXt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PsdhoXtmXt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PsdhoXtmXt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PsdhoXtmXt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684096468418749424\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PsdhoXtmXt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45931 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PsdhoXtmXt" is_bounded:BOUNDED windowing_strategy_id:"w0@PsdhoXtmXt"}} windowing_strategies:{key:"w0@PsdhoXtmXt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PsdhoXtmXt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PsdhoXtmXt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PsdhoXtmXt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684096468418749424\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PsdhoXtmXt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 15 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00021a7c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00021a7c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae820?, 0xc0006ae3c0?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00065bb40, 0xf}, 0xc000575d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae340?, 0xc0006ae3c0?}, {0xc0006c0780, 0x52}, {0x1?}, {0xc000575ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00065bb40, 0xf}, {0xc0006c0780, 0x52}, {0xf25d40, 0xc00046ce90})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103860, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.415s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-203354
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-203354
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:153677350bcd6ad9bc1ba79c388d04619d997f1f67f51488bfc0cc160c7bc1a4
Deleted: sha256:4e9dc8eb0fa5372315f6a6239ae856f2eb52dadaef51739ceed4221d4ee52121
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-203354
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:153677350bcd6ad9bc1ba79c388d04619d997f1f67f51488bfc0cc160c7bc1a4
Associated tags:
- 20230514-203354
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-203354
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-203354].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:153677350bcd6ad9bc1ba79c388d04619d997f1f67f51488bfc0cc160c7bc1a4].
$ rm -rf /tmp/tmp.updVcBIsIt
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514202050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4bd42494c09075a2d890ebeaa404def4c7bb8e9a094d9d63fd21f18e3cafdbf5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514202050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4bd42494c09075a2d890ebeaa404def4c7bb8e9a094d9d63fd21f18e3cafdbf5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514202050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4bd42494c09075a2d890ebeaa404def4c7bb8e9a094d9d63fd21f18e3cafdbf5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4bd42494c09075a2d890ebeaa404def4c7bb8e9a094d9d63fd21f18e3cafdbf5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4bd42494c09075a2d890ebeaa404def4c7bb8e9a094d9d63fd21f18e3cafdbf5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4bd42494c09075a2d890ebeaa404def4c7bb8e9a094d9d63fd21f18e3cafdbf5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514202050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4569038d5b3c304b8cb36ef16c94ce6802e0f91dd0f5290471f9e940ea91e48a
Deleted: sha256:f2fefa06687bf23c6edb0e6e0dcf9887c3aa9966e9d8e7096f609b7ffb5635fb
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514202050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4569038d5b3c304b8cb36ef16c94ce6802e0f91dd0f5290471f9e940ea91e48a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514202050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4569038d5b3c304b8cb36ef16c94ce6802e0f91dd0f5290471f9e940ea91e48a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4569038d5b3c304b8cb36ef16c94ce6802e0f91dd0f5290471f9e940ea91e48a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4569038d5b3c304b8cb36ef16c94ce6802e0f91dd0f5290471f9e940ea91e48a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4569038d5b3c304b8cb36ef16c94ce6802e0f91dd0f5290471f9e940ea91e48a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2848599.
Stopping expansion service pid: 2848600.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 8s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/muv7ekevdx4os
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1634
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1634/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514142043",
"environmentId": "lFcmAVIuhRbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-143458"
}
]
},
"name": "go-testxlang_partition-43",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/14 15:15:53 Submitted job: 2023-05-14_08_15_52-823903977675014344
2023/05/14 15:15:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-14_08_15_52-823903977675014344?project=apache-beam-testing
2023/05/14 15:15:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-14_08_15_52-823903977675014344
2023/05/14 15:15:53 Job state: JOB_STATE_PENDING ...
2023/05/14 15:16:23 Job still running ...
2023/05/14 15:16:53 Job still running ...
2023/05/14 15:17:23 Job still running ...
2023/05/14 15:17:53 Job still running ...
2023/05/14 15:18:23 Job still running ...
2023/05/14 15:18:53 Job still running ...
2023/05/14 15:19:23 Job still running ...
2023/05/14 15:19:53 Job still running ...
2023/05/14 15:20:23 Job still running ...
2023/05/14 15:20:53 Job still running ...
2023/05/14 15:21:23 Job still running ...
2023/05/14 15:21:53 Job still running ...
2023/05/14 15:22:23 Job still running ...
2023/05/14 15:22:53 Job still running ...
2023/05/14 15:23:23 Job still running ...
2023/05/14 15:23:54 Job still running ...
2023/05/14 15:24:24 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-14_08_15_52-823903977675014344 failed
--- FAIL: TestXLang_Partition (550.69s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2966.400s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684074930931284932
--- FAIL: TestBigQueryIO_BasicWriteRead (4.39s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33557 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uMOEBDVETS" is_bounded:BOUNDED windowing_strategy_id:"w0@uMOEBDVETS"}} windowing_strategies:{key:"w0@uMOEBDVETS" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uMOEBDVETS" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uMOEBDVETS" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uMOEBDVETS" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684074930931284932\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uMOEBDVETS"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33557 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uMOEBDVETS" is_bounded:BOUNDED windowing_strategy_id:"w0@uMOEBDVETS"}} windowing_strategies:{key:"w0@uMOEBDVETS" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uMOEBDVETS" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uMOEBDVETS" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uMOEBDVETS" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684074930931284932\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uMOEBDVETS"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0005d6340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0005d6340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aea00?, 0xc00057e3c0?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc0005afdd0, 0xf}, 0xc0001a5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae840?, 0xc00057e3c0?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc0001a5ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005afdd0, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc00046d210})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000581a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000581a00, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.418s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-143458
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-143458
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c287ee71993bfd4c2fbcd7536e96cb26b5d33b717fd5ad6b306feebfa95f4411
Deleted: sha256:d1a815ccbdf4586b147780e2ec31ed03f4aceafe173f670ccc16e7b62e05eec5
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-143458
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c287ee71993bfd4c2fbcd7536e96cb26b5d33b717fd5ad6b306feebfa95f4411
Associated tags:
- 20230514-143458
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-143458
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-143458].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c287ee71993bfd4c2fbcd7536e96cb26b5d33b717fd5ad6b306feebfa95f4411].
$ rm -rf /tmp/tmp.VacQkscE5b
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514142043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:06e27b1c1be6129dbad310748754032696695112e648975062ab902c3b749597
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514142043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:06e27b1c1be6129dbad310748754032696695112e648975062ab902c3b749597]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514142043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:06e27b1c1be6129dbad310748754032696695112e648975062ab902c3b749597])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:06e27b1c1be6129dbad310748754032696695112e648975062ab902c3b749597
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:06e27b1c1be6129dbad310748754032696695112e648975062ab902c3b749597
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:06e27b1c1be6129dbad310748754032696695112e648975062ab902c3b749597].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514142043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8b909cfbd0558fe4e1a12e1dac70b6eff6a07601af8dd2e15016c4764ee5fcd
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514142043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8b909cfbd0558fe4e1a12e1dac70b6eff6a07601af8dd2e15016c4764ee5fcd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514142043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8b909cfbd0558fe4e1a12e1dac70b6eff6a07601af8dd2e15016c4764ee5fcd])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8b909cfbd0558fe4e1a12e1dac70b6eff6a07601af8dd2e15016c4764ee5fcd
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8b909cfbd0558fe4e1a12e1dac70b6eff6a07601af8dd2e15016c4764ee5fcd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8b909cfbd0558fe4e1a12e1dac70b6eff6a07601af8dd2e15016c4764ee5fcd].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2749677.
Stopping expansion service pid: 2749678.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 50s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/3j4yz6fmc637q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1633
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1633/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514082052",
"environmentId": "hRoHatwDfIbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-083359"
}
]
},
"name": "go-testxlang_partition-194",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/14 09:17:27 Submitted job: 2023-05-14_02_17_26-10397671311301144131
2023/05/14 09:17:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-14_02_17_26-10397671311301144131?project=apache-beam-testing
2023/05/14 09:17:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-14_02_17_26-10397671311301144131
2023/05/14 09:17:27 Job state: JOB_STATE_PENDING ...
2023/05/14 09:17:57 Job still running ...
2023/05/14 09:18:27 Job still running ...
2023/05/14 09:18:57 Job still running ...
2023/05/14 09:19:27 Job still running ...
2023/05/14 09:19:57 Job still running ...
2023/05/14 09:20:27 Job still running ...
2023/05/14 09:20:57 Job still running ...
2023/05/14 09:21:27 Job still running ...
2023/05/14 09:21:57 Job still running ...
2023/05/14 09:22:27 Job still running ...
2023/05/14 09:22:57 Job still running ...
2023/05/14 09:23:27 Job still running ...
2023/05/14 09:23:57 Job still running ...
2023/05/14 09:24:27 Job still running ...
2023/05/14 09:24:57 Job still running ...
2023/05/14 09:25:27 Job still running ...
2023/05/14 09:25:57 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-14_02_17_26-10397671311301144131 failed
--- FAIL: TestXLang_Partition (549.78s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3117.690s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684053273492436911
--- FAIL: TestBigQueryIO_BasicWriteRead (4.41s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38877 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@byIKeqmbaz" is_bounded:BOUNDED windowing_strategy_id:"w0@byIKeqmbaz"}} windowing_strategies:{key:"w0@byIKeqmbaz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@byIKeqmbaz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@byIKeqmbaz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@byIKeqmbaz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684053273492436911\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"byIKeqmbaz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38877 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@byIKeqmbaz" is_bounded:BOUNDED windowing_strategy_id:"w0@byIKeqmbaz"}} windowing_strategies:{key:"w0@byIKeqmbaz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@byIKeqmbaz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@byIKeqmbaz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@byIKeqmbaz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684053273492436911\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"byIKeqmbaz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0006ea440})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0006ea440})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000702100?, 0xc000596000?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00046dcb0, 0xf}, 0xc000577d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000702080?, 0xc000596000?}, {0xc0007127e0, 0x52}, {0x1?}, {0xc000577ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dcb0, 0xf}, {0xc0007127e0, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2d00, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.431s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-083359
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-083359
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4585e3b81bd9adbc7a147a6f16ca0efb883f66a47c0c5735f6bf05ddf69c27c2
Deleted: sha256:fe2c021f18375c556a6cc1a113c295e1dc246c909c04dc35652d754ebf9196c2
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-083359
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4585e3b81bd9adbc7a147a6f16ca0efb883f66a47c0c5735f6bf05ddf69c27c2
Associated tags:
- 20230514-083359
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-083359
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-083359].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4585e3b81bd9adbc7a147a6f16ca0efb883f66a47c0c5735f6bf05ddf69c27c2].
$ rm -rf /tmp/tmp.Y80lBaGOmY
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514082052
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:19308fc9cc378a7c614684932c7e6d449d85e6816d381b7826c046ee62bb50e4
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514082052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:19308fc9cc378a7c614684932c7e6d449d85e6816d381b7826c046ee62bb50e4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514082052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:19308fc9cc378a7c614684932c7e6d449d85e6816d381b7826c046ee62bb50e4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:19308fc9cc378a7c614684932c7e6d449d85e6816d381b7826c046ee62bb50e4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:19308fc9cc378a7c614684932c7e6d449d85e6816d381b7826c046ee62bb50e4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:19308fc9cc378a7c614684932c7e6d449d85e6816d381b7826c046ee62bb50e4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514082052
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c70f7dd010b666b82ae91b99e7e2794b2dcd0f6714bca7d4021c31ea7c929afb
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514082052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c70f7dd010b666b82ae91b99e7e2794b2dcd0f6714bca7d4021c31ea7c929afb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514082052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c70f7dd010b666b82ae91b99e7e2794b2dcd0f6714bca7d4021c31ea7c929afb])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c70f7dd010b666b82ae91b99e7e2794b2dcd0f6714bca7d4021c31ea7c929afb
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c70f7dd010b666b82ae91b99e7e2794b2dcd0f6714bca7d4021c31ea7c929afb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c70f7dd010b666b82ae91b99e7e2794b2dcd0f6714bca7d4021c31ea7c929afb].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2653089.
Stopping expansion service pid: 2653090.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 13s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/lctlydugcarwu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1632
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1632/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-023337",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514022042",
"environmentId": "NGSlRRfjQLbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-023337"
}
]
},
"name": "go-testxlang_partition-484",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/14 03:17:01 Submitted job: 2023-05-13_20_17_00-1242412461503605296
2023/05/14 03:17:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-13_20_17_00-1242412461503605296?project=apache-beam-testing
2023/05/14 03:17:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-13_20_17_00-1242412461503605296
2023/05/14 03:17:01 Job state: JOB_STATE_PENDING ...
2023/05/14 03:17:31 Job still running ...
2023/05/14 03:18:01 Job still running ...
2023/05/14 03:18:31 Job still running ...
2023/05/14 03:19:01 Job still running ...
2023/05/14 03:19:31 Job still running ...
2023/05/14 03:20:01 Job still running ...
2023/05/14 03:20:31 Job still running ...
2023/05/14 03:21:01 Job still running ...
2023/05/14 03:21:31 Job still running ...
2023/05/14 03:22:01 Job still running ...
2023/05/14 03:22:31 Job still running ...
2023/05/14 03:23:01 Job still running ...
2023/05/14 03:23:31 Job still running ...
2023/05/14 03:24:01 Job still running ...
2023/05/14 03:24:31 Job still running ...
2023/05/14 03:25:01 Job still running ...
2023/05/14 03:25:31 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-13_20_17_00-1242412461503605296 failed
--- FAIL: TestXLang_Partition (550.18s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3115.695s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684031649412249830
--- FAIL: TestBigQueryIO_BasicWriteRead (4.39s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39483 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qLCSzVBjkn" is_bounded:BOUNDED windowing_strategy_id:"w0@qLCSzVBjkn"}} windowing_strategies:{key:"w0@qLCSzVBjkn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qLCSzVBjkn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qLCSzVBjkn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qLCSzVBjkn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684031649412249830\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qLCSzVBjkn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39483 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qLCSzVBjkn" is_bounded:BOUNDED windowing_strategy_id:"w0@qLCSzVBjkn"}} windowing_strategies:{key:"w0@qLCSzVBjkn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qLCSzVBjkn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qLCSzVBjkn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qLCSzVBjkn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684031649412249830\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qLCSzVBjkn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0003fa480})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0003fa480})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00016cae0?, 0xc0001362d0?}, {0x11c9c19, 0x39}, {0xc000158180?, 0x10c9440?, 0x1?}, {0xc000045f20, 0xf}, 0xc0002e7d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00016ca40?, 0xc0001362d0?}, {0xc000050960, 0x52}, {0x1?}, {0xc0002e7ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f20, 0xf}, {0xc000050960, 0x52}, {0xf25d40, 0xc000489330})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000c8ea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000c8ea0, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.412s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:78585d63a172f89e3916b13de1eab9ba0525b5f3c0a9f6a21b8b52dc4f1a9bf3
Associated tags:
- 20230514-023337
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-023337
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230514-023337].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:78585d63a172f89e3916b13de1eab9ba0525b5f3c0a9f6a21b8b52dc4f1a9bf3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:544ca168d94a8cb1e7ec086d0e2ed25cfbf4987cedb43cc8adb8723f83d10d3d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230514022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:544ca168d94a8cb1e7ec086d0e2ed25cfbf4987cedb43cc8adb8723f83d10d3d])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:544ca168d94a8cb1e7ec086d0e2ed25cfbf4987cedb43cc8adb8723f83d10d3d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:544ca168d94a8cb1e7ec086d0e2ed25cfbf4987cedb43cc8adb8723f83d10d3d].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1be492d0c5ff8bf3b7d17371d297d2e51ae0ebe98ebc197a8a573ffd0a541b3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230514022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1be492d0c5ff8bf3b7d17371d297d2e51ae0ebe98ebc197a8a573ffd0a541b3])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1be492d0c5ff8bf3b7d17371d297d2e51ae0ebe98ebc197a8a573ffd0a541b3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1be492d0c5ff8bf3b7d17371d297d2e51ae0ebe98ebc197a8a573ffd0a541b3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 59s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/jo6sup523rt4q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1631
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1631/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513202050",
"environmentId": "nerBbreQBgbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-203410"
}
]
},
"name": "go-testxlang_partition-938",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/13 21:19:08 Submitted job: 2023-05-13_14_19_08-7949647218115348365
2023/05/13 21:19:08 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-13_14_19_08-7949647218115348365?project=apache-beam-testing
2023/05/13 21:19:08 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-13_14_19_08-7949647218115348365
2023/05/13 21:19:08 Job state: JOB_STATE_PENDING ...
2023/05/13 21:19:38 Job still running ...
2023/05/13 21:20:08 Job still running ...
2023/05/13 21:20:38 Job still running ...
2023/05/13 21:21:09 Job still running ...
2023/05/13 21:21:39 Job still running ...
2023/05/13 21:22:11 Job still running ...
2023/05/13 21:22:42 Job still running ...
2023/05/13 21:23:12 Job still running ...
2023/05/13 21:23:42 Job still running ...
2023/05/13 21:24:12 Job still running ...
2023/05/13 21:24:42 Job still running ...
2023/05/13 21:25:12 Job still running ...
2023/05/13 21:25:42 Job still running ...
2023/05/13 21:26:12 Job still running ...
2023/05/13 21:26:42 Job still running ...
2023/05/13 21:27:12 Job still running ...
2023/05/13 21:27:42 Job still running ...
2023/05/13 21:28:12 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-13_14_19_08-7949647218115348365 failed
--- FAIL: TestXLang_Partition (583.66s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3239.746s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684010085871987999
--- FAIL: TestBigQueryIO_BasicWriteRead (4.76s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45487 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PGeXaLESMN" is_bounded:BOUNDED windowing_strategy_id:"w0@PGeXaLESMN"}} windowing_strategies:{key:"w0@PGeXaLESMN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PGeXaLESMN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PGeXaLESMN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PGeXaLESMN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684010085871987999\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PGeXaLESMN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45487 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PGeXaLESMN" is_bounded:BOUNDED windowing_strategy_id:"w0@PGeXaLESMN"}} windowing_strategies:{key:"w0@PGeXaLESMN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PGeXaLESMN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PGeXaLESMN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PGeXaLESMN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1684010085871987999\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PGeXaLESMN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 16 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00066a800})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00066a800})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aea00?, 0xc0005763c0?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x1?}, {0xc0005afdd0, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae840?, 0xc0005763c0?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005afdd0, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc00046d210})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583380, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.791s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-203410
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-203410
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e3e7a59d2a4de62554166704bce92e879bfec86876a2a2783048aa5915c69ec2
Deleted: sha256:35f32c4fb8b33d1f08abbf6dc4f5413232fb7e8cd17820d0e2746dce3227939d
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-203410
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e3e7a59d2a4de62554166704bce92e879bfec86876a2a2783048aa5915c69ec2
Associated tags:
- 20230513-203410
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-203410
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-203410].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e3e7a59d2a4de62554166704bce92e879bfec86876a2a2783048aa5915c69ec2].
$ rm -rf /tmp/tmp.NBEE2ri3Qe
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513202050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:94596de51bc3046087a3b303b31c74dff0cd5df0b97cd2913f1c81da385023fd
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513202050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:94596de51bc3046087a3b303b31c74dff0cd5df0b97cd2913f1c81da385023fd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513202050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:94596de51bc3046087a3b303b31c74dff0cd5df0b97cd2913f1c81da385023fd])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:94596de51bc3046087a3b303b31c74dff0cd5df0b97cd2913f1c81da385023fd
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:94596de51bc3046087a3b303b31c74dff0cd5df0b97cd2913f1c81da385023fd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:94596de51bc3046087a3b303b31c74dff0cd5df0b97cd2913f1c81da385023fd].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513202050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5f63930c3099a43e79997902931508c299c096aa0cfffaeb56799869f8a15ae9
Deleted: sha256:bd3b5b81376e47232935a056f80011efca1c205198d57a215545d0a09c7bc0dd
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513202050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5f63930c3099a43e79997902931508c299c096aa0cfffaeb56799869f8a15ae9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513202050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5f63930c3099a43e79997902931508c299c096aa0cfffaeb56799869f8a15ae9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5f63930c3099a43e79997902931508c299c096aa0cfffaeb56799869f8a15ae9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5f63930c3099a43e79997902931508c299c096aa0cfffaeb56799869f8a15ae9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5f63930c3099a43e79997902931508c299c096aa0cfffaeb56799869f8a15ae9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2427789.
Stopping expansion service pid: 2427790.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 29s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/bzsh3q5esfyg2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1630
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1630/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513142053",
"environmentId": "UnRqyNwayjbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-143525"
}
]
},
"name": "go-testxlang_partition-781",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/13 15:20:28 Submitted job: 2023-05-13_08_20_28-11666340125518561090
2023/05/13 15:20:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-13_08_20_28-11666340125518561090?project=apache-beam-testing
2023/05/13 15:20:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-13_08_20_28-11666340125518561090
2023/05/13 15:20:28 Job state: JOB_STATE_PENDING ...
2023/05/13 15:20:58 Job still running ...
2023/05/13 15:21:28 Job still running ...
2023/05/13 15:21:58 Job still running ...
2023/05/13 15:22:28 Job still running ...
2023/05/13 15:22:58 Job still running ...
2023/05/13 15:23:28 Job still running ...
2023/05/13 15:23:58 Job still running ...
2023/05/13 15:24:28 Job still running ...
2023/05/13 15:24:58 Job still running ...
2023/05/13 15:25:28 Job still running ...
2023/05/13 15:25:58 Job still running ...
2023/05/13 15:26:29 Job still running ...
2023/05/13 15:26:59 Job still running ...
2023/05/13 15:27:29 Job still running ...
2023/05/13 15:27:59 Job still running ...
2023/05/13 15:28:29 Job still running ...
2023/05/13 15:28:59 Job still running ...
2023/05/13 15:29:29 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-13_08_20_28-11666340125518561090 failed
--- FAIL: TestXLang_Partition (580.49s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3243.170s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683988559399275742
--- FAIL: TestBigQueryIO_BasicWriteRead (4.62s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44705 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LyQMwQswhb" is_bounded:BOUNDED windowing_strategy_id:"w0@LyQMwQswhb"}} windowing_strategies:{key:"w0@LyQMwQswhb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LyQMwQswhb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LyQMwQswhb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LyQMwQswhb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683988559399275742\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LyQMwQswhb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44705 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LyQMwQswhb" is_bounded:BOUNDED windowing_strategy_id:"w0@LyQMwQswhb"}} windowing_strategies:{key:"w0@LyQMwQswhb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LyQMwQswhb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LyQMwQswhb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LyQMwQswhb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683988559399275742\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LyQMwQswhb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0006e26c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0006e26c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e0c0?, 0xc00068a000?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00046df20, 0xf}, 0xc0001a5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00068a000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc0001a5ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046df20, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d9a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d9a00, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.645s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-143525
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-143525
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0fbd0bc2bf4d9c5b1de69a0cbc58de5183ce0574f78584cb821ccea84eca001a
Deleted: sha256:158d53ae1f5add2fd267706f28f7154657b263d0eb907d8066b01f54982c931b
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-143525
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0fbd0bc2bf4d9c5b1de69a0cbc58de5183ce0574f78584cb821ccea84eca001a
Associated tags:
- 20230513-143525
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-143525
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-143525].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0fbd0bc2bf4d9c5b1de69a0cbc58de5183ce0574f78584cb821ccea84eca001a].
$ rm -rf /tmp/tmp.6LISr2gau0
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513142053
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:adcf967d5d2d5e6b139d69b390fb56664a3702a62563bd1412a32851828faf1a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513142053]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:adcf967d5d2d5e6b139d69b390fb56664a3702a62563bd1412a32851828faf1a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513142053] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:adcf967d5d2d5e6b139d69b390fb56664a3702a62563bd1412a32851828faf1a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:adcf967d5d2d5e6b139d69b390fb56664a3702a62563bd1412a32851828faf1a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:adcf967d5d2d5e6b139d69b390fb56664a3702a62563bd1412a32851828faf1a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:adcf967d5d2d5e6b139d69b390fb56664a3702a62563bd1412a32851828faf1a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513142053
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2bb46fa18f97c72d2d21aee467a45f40c7b89a1d8ab32d0495efbf07ce541f6c
Deleted: sha256:4173e25b79fb55fc0d6d2752bec95dd1103d54d0240ffb615b2f77f1b3b05c62
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513142053]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2bb46fa18f97c72d2d21aee467a45f40c7b89a1d8ab32d0495efbf07ce541f6c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513142053] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2bb46fa18f97c72d2d21aee467a45f40c7b89a1d8ab32d0495efbf07ce541f6c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2bb46fa18f97c72d2d21aee467a45f40c7b89a1d8ab32d0495efbf07ce541f6c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2bb46fa18f97c72d2d21aee467a45f40c7b89a1d8ab32d0495efbf07ce541f6c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2bb46fa18f97c72d2d21aee467a45f40c7b89a1d8ab32d0495efbf07ce541f6c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2233681.
Stopping expansion service pid: 2233682.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 46s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/jru6jfdfeknog
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1629
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1629/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513082042",
"environmentId": "YHCvqWTyOVbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-083439"
}
]
},
"name": "go-testxlang_partition-593",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/13 09:19:42 Submitted job: 2023-05-13_02_19_41-8127011767632365019
2023/05/13 09:19:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-13_02_19_41-8127011767632365019?project=apache-beam-testing
2023/05/13 09:19:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-13_02_19_41-8127011767632365019
2023/05/13 09:19:42 Job state: JOB_STATE_PENDING ...
2023/05/13 09:20:12 Job still running ...
2023/05/13 09:20:42 Job still running ...
2023/05/13 09:21:12 Job still running ...
2023/05/13 09:21:42 Job still running ...
2023/05/13 09:22:12 Job still running ...
2023/05/13 09:22:42 Job still running ...
2023/05/13 09:23:12 Job still running ...
2023/05/13 09:23:42 Job still running ...
2023/05/13 09:24:12 Job still running ...
2023/05/13 09:24:42 Job still running ...
2023/05/13 09:25:12 Job still running ...
2023/05/13 09:25:42 Job still running ...
2023/05/13 09:26:12 Job still running ...
2023/05/13 09:26:42 Job still running ...
2023/05/13 09:27:12 Job still running ...
2023/05/13 09:27:43 Job still running ...
2023/05/13 09:28:13 Job still running ...
2023/05/13 09:28:43 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-13_02_19_41-8127011767632365019 failed
--- FAIL: TestXLang_Partition (580.43s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3241.722s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683966914567687212
--- FAIL: TestBigQueryIO_BasicWriteRead (4.64s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39305 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MhWcSGSjGC" is_bounded:BOUNDED windowing_strategy_id:"w0@MhWcSGSjGC"}} windowing_strategies:{key:"w0@MhWcSGSjGC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MhWcSGSjGC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MhWcSGSjGC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MhWcSGSjGC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683966914567687212\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MhWcSGSjGC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39305 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MhWcSGSjGC" is_bounded:BOUNDED windowing_strategy_id:"w0@MhWcSGSjGC"}} windowing_strategies:{key:"w0@MhWcSGSjGC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MhWcSGSjGC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MhWcSGSjGC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MhWcSGSjGC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683966914567687212\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MhWcSGSjGC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 21 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc000314240})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc000314240})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010ef20?, 0xc0001583c0?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x1?}, {0xc00046de10, 0xf}, 0xc00021dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010eea0?, 0xc0001583c0?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc00021dea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc000131220})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d9d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d9d40, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.664s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-083439
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-083439
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:81f9c36bcccb86e34b6d88911c62922789e21d312ab39a0c207e602e539a8303
Deleted: sha256:f5956dd65f91d665ec24e5e42c7c9d31f86fe3375b03fbc651c8a144ede93073
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-083439
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:81f9c36bcccb86e34b6d88911c62922789e21d312ab39a0c207e602e539a8303
Associated tags:
- 20230513-083439
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-083439
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-083439].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:81f9c36bcccb86e34b6d88911c62922789e21d312ab39a0c207e602e539a8303].
$ rm -rf /tmp/tmp.4GaQ4eH0EF
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513082042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e920bfebbbb05d102aa1e29bf25871ea0951e4766c1d2b2b15b2cc08f775862
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513082042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e920bfebbbb05d102aa1e29bf25871ea0951e4766c1d2b2b15b2cc08f775862]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513082042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e920bfebbbb05d102aa1e29bf25871ea0951e4766c1d2b2b15b2cc08f775862])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e920bfebbbb05d102aa1e29bf25871ea0951e4766c1d2b2b15b2cc08f775862
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e920bfebbbb05d102aa1e29bf25871ea0951e4766c1d2b2b15b2cc08f775862
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e920bfebbbb05d102aa1e29bf25871ea0951e4766c1d2b2b15b2cc08f775862].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513082042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74cbef6a6949bdb66dfd80fd702f06e7e08c02fd9af51f1d880db186ac520f1e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513082042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74cbef6a6949bdb66dfd80fd702f06e7e08c02fd9af51f1d880db186ac520f1e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513082042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74cbef6a6949bdb66dfd80fd702f06e7e08c02fd9af51f1d880db186ac520f1e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74cbef6a6949bdb66dfd80fd702f06e7e08c02fd9af51f1d880db186ac520f1e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74cbef6a6949bdb66dfd80fd702f06e7e08c02fd9af51f1d880db186ac520f1e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74cbef6a6949bdb66dfd80fd702f06e7e08c02fd9af51f1d880db186ac520f1e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2146736.
Stopping expansion service pid: 2146737.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 12s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/ve5xapiwp7yng
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1628
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1628/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-023609",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513022055",
"environmentId": "jtGeqDHdqHbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-023609"
}
]
},
"name": "go-testxlang_partition-286",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/13 03:21:13 Submitted job: 2023-05-12_20_21_13-11961193820088049966
2023/05/13 03:21:13 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-12_20_21_13-11961193820088049966?project=apache-beam-testing
2023/05/13 03:21:13 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-12_20_21_13-11961193820088049966
2023/05/13 03:21:13 Job state: JOB_STATE_PENDING ...
2023/05/13 03:21:43 Job still running ...
2023/05/13 03:22:13 Job still running ...
2023/05/13 03:22:44 Job still running ...
2023/05/13 03:23:14 Job still running ...
2023/05/13 03:23:44 Job still running ...
2023/05/13 03:24:14 Job still running ...
2023/05/13 03:24:44 Job still running ...
2023/05/13 03:25:14 Job still running ...
2023/05/13 03:25:44 Job still running ...
2023/05/13 03:26:14 Job still running ...
2023/05/13 03:26:44 Job still running ...
2023/05/13 03:27:14 Job still running ...
2023/05/13 03:27:44 Job still running ...
2023/05/13 03:28:14 Job still running ...
2023/05/13 03:28:44 Job still running ...
2023/05/13 03:29:14 Job still running ...
2023/05/13 03:29:44 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-12_20_21_13-11961193820088049966 failed
--- FAIL: TestXLang_Partition (552.88s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3211.915s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683945405790969222
--- FAIL: TestBigQueryIO_BasicWriteRead (4.79s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40439 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dWsrEQsGLn" is_bounded:BOUNDED windowing_strategy_id:"w0@dWsrEQsGLn"}} windowing_strategies:{key:"w0@dWsrEQsGLn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dWsrEQsGLn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dWsrEQsGLn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dWsrEQsGLn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683945405790969222\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dWsrEQsGLn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40439 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dWsrEQsGLn" is_bounded:BOUNDED windowing_strategy_id:"w0@dWsrEQsGLn"}} windowing_strategies:{key:"w0@dWsrEQsGLn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dWsrEQsGLn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dWsrEQsGLn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dWsrEQsGLn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683945405790969222\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dWsrEQsGLn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0006963c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0006963c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00016cb20?, 0xc000136280?}, {0x11c9c19, 0x39}, {0xc000158180?, 0x10c9440?, 0x1?}, {0xc00055fe80, 0xf}, 0xc000219d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00016caa0?, 0xc000136280?}, {0xc00052c840, 0x52}, {0x1?}, {0xc000219ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00055fe80, 0xf}, {0xc00052c840, 0x52}, {0xf25d40, 0xc0004892a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000501ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000501ba0, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.817s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:da2a3066e647a0b669c9abfd21fa839f47e4f5326f600909fd1574b24b8b21ca
Associated tags:
- 20230513-023609
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-023609
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230513-023609].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:da2a3066e647a0b669c9abfd21fa839f47e4f5326f600909fd1574b24b8b21ca].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513022055]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4897c23977bdc0b5f61f8b09e277417fb141ad1fabe36a0341e4098015ec4149]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230513022055] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4897c23977bdc0b5f61f8b09e277417fb141ad1fabe36a0341e4098015ec4149])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4897c23977bdc0b5f61f8b09e277417fb141ad1fabe36a0341e4098015ec4149
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4897c23977bdc0b5f61f8b09e277417fb141ad1fabe36a0341e4098015ec4149].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513022055]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a2bb6fffbfcadab1b31c6e66d75dfd639d389450627b6470df0e11f8c9d6a038]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230513022055] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a2bb6fffbfcadab1b31c6e66d75dfd639d389450627b6470df0e11f8c9d6a038])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a2bb6fffbfcadab1b31c6e66d75dfd639d389450627b6470df0e11f8c9d6a038
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a2bb6fffbfcadab1b31c6e66d75dfd639d389450627b6470df0e11f8c9d6a038].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/bmq5uc2wtlexg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1627
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1627/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512202041",
"environmentId": "CZUiATAchxbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-203423"
}
]
},
"name": "go-testxlang_partition-186",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/12 21:24:11 Submitted job: 2023-05-12_14_24_10-10857047495362947702
2023/05/12 21:24:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-12_14_24_10-10857047495362947702?project=apache-beam-testing
2023/05/12 21:24:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-12_14_24_10-10857047495362947702
2023/05/12 21:24:11 Job state: JOB_STATE_PENDING ...
2023/05/12 21:24:41 Job still running ...
2023/05/12 21:25:11 Job still running ...
2023/05/12 21:25:41 Job still running ...
2023/05/12 21:26:11 Job still running ...
2023/05/12 21:26:41 Job still running ...
2023/05/12 21:27:11 Job still running ...
2023/05/12 21:27:41 Job still running ...
2023/05/12 21:28:11 Job still running ...
2023/05/12 21:28:41 Job still running ...
2023/05/12 21:29:11 Job still running ...
2023/05/12 21:29:41 Job still running ...
2023/05/12 21:30:11 Job still running ...
2023/05/12 21:30:41 Job still running ...
2023/05/12 21:31:11 Job still running ...
2023/05/12 21:31:41 Job still running ...
2023/05/12 21:32:11 Job still running ...
2023/05/12 21:32:41 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-12_14_24_10-10857047495362947702 failed
--- FAIL: TestXLang_Partition (552.98s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3489.279s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683923713027486366
--- FAIL: TestBigQueryIO_BasicWriteRead (7.26s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45015 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ooTZZAMUoV" is_bounded:BOUNDED windowing_strategy_id:"w0@ooTZZAMUoV"}} windowing_strategies:{key:"w0@ooTZZAMUoV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ooTZZAMUoV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ooTZZAMUoV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ooTZZAMUoV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683923713027486366\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ooTZZAMUoV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45015 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ooTZZAMUoV" is_bounded:BOUNDED windowing_strategy_id:"w0@ooTZZAMUoV"}} windowing_strategies:{key:"w0@ooTZZAMUoV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ooTZZAMUoV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ooTZZAMUoV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ooTZZAMUoV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683923713027486366\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ooTZZAMUoV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc000216b40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc000216b40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00064c0e0?, 0xc00012c000?}, {0x11c9c19, 0x39}, {0xc0001340c0?, 0x10c9440?, 0x41bc91?}, {0xc000623480, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00064c060?, 0xc00012c000?}, {0xc000050f00, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000623480, 0xf}, {0xc000050f00, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103860, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 10.291s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.044s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.151s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-203423
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-203423
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:136715f26ab5497852aac9b54bc2960b54d642a534dc2a1a2d25169152645461
Deleted: sha256:62c2b6e080c232ce4e717228d64bb54fd476a20daad030be96da859c9f0ab1c0
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-203423
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:136715f26ab5497852aac9b54bc2960b54d642a534dc2a1a2d25169152645461
Associated tags:
- 20230512-203423
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-203423
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-203423].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:136715f26ab5497852aac9b54bc2960b54d642a534dc2a1a2d25169152645461].
$ rm -rf /tmp/tmp.BmWXDUr5d1
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230512202041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d32ffbef5ea514e6a4ae20b9541a7d56a30849b771b618eeb3876e102571e9ab
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230512202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d32ffbef5ea514e6a4ae20b9541a7d56a30849b771b618eeb3876e102571e9ab]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230512202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d32ffbef5ea514e6a4ae20b9541a7d56a30849b771b618eeb3876e102571e9ab])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d32ffbef5ea514e6a4ae20b9541a7d56a30849b771b618eeb3876e102571e9ab
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d32ffbef5ea514e6a4ae20b9541a7d56a30849b771b618eeb3876e102571e9ab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d32ffbef5ea514e6a4ae20b9541a7d56a30849b771b618eeb3876e102571e9ab].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512202041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17d460dde2585d9e355380a523bc8168eeeff59859263e402507e71e14e34999
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17d460dde2585d9e355380a523bc8168eeeff59859263e402507e71e14e34999]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17d460dde2585d9e355380a523bc8168eeeff59859263e402507e71e14e34999])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17d460dde2585d9e355380a523bc8168eeeff59859263e402507e71e14e34999
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17d460dde2585d9e355380a523bc8168eeeff59859263e402507e71e14e34999
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17d460dde2585d9e355380a523bc8168eeeff59859263e402507e71e14e34999].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1661459.
Stopping expansion service pid: 1661460.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 13m 11s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/7xa5j26b2v3ie
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1626
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1626/display/redirect?page=changes>
Changes:
[noreply] Capture build scans on ge.apache.org to benefit from deep build insights
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-143442",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512142054",
"environmentId": "PJsyVoDcuvbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-143442"
}
]
},
"name": "go-testxlang_partition-626",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/12 15:21:27 Submitted job: 2023-05-12_08_21_27-16117497362181062952
2023/05/12 15:21:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-12_08_21_27-16117497362181062952?project=apache-beam-testing
2023/05/12 15:21:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-12_08_21_27-16117497362181062952
2023/05/12 15:21:27 Job state: JOB_STATE_PENDING ...
2023/05/12 15:21:58 Job still running ...
2023/05/12 15:22:28 Job still running ...
2023/05/12 15:22:58 Job still running ...
2023/05/12 15:23:28 Job still running ...
2023/05/12 15:23:58 Job still running ...
2023/05/12 15:24:28 Job still running ...
2023/05/12 15:24:58 Job still running ...
2023/05/12 15:25:28 Job still running ...
2023/05/12 15:25:58 Job still running ...
2023/05/12 15:26:28 Job still running ...
2023/05/12 15:26:58 Job still running ...
2023/05/12 15:27:28 Job still running ...
2023/05/12 15:27:58 Job still running ...
2023/05/12 15:28:28 Job still running ...
2023/05/12 15:28:58 Job still running ...
2023/05/12 15:29:28 Job still running ...
2023/05/12 15:29:58 Job still running ...
2023/05/12 15:30:28 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-12_08_21_27-16117497362181062952 failed
--- FAIL: TestXLang_Partition (587.55s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3343.664s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683902118281750537
--- FAIL: TestBigQueryIO_BasicWriteRead (4.76s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36223 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hkraVxAEWe" is_bounded:BOUNDED windowing_strategy_id:"w0@hkraVxAEWe"}} windowing_strategies:{key:"w0@hkraVxAEWe" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hkraVxAEWe" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hkraVxAEWe" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hkraVxAEWe" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683902118281750537\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hkraVxAEWe"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36223 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hkraVxAEWe" is_bounded:BOUNDED windowing_strategy_id:"w0@hkraVxAEWe"}} windowing_strategies:{key:"w0@hkraVxAEWe" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hkraVxAEWe" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hkraVxAEWe" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hkraVxAEWe" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683902118281750537\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hkraVxAEWe"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 14 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0001a4880})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0001a4880})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005ac0a0?, 0xc0005ae000?}, {0x11c9c19, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc000141d70, 0xf}, 0xc000127d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005ac020?, 0xc0005ae000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc000127ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000141d70, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc00046c008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103d40, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.785s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.038s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7bf52830e76a35f46ecd0503273f384a13714eca8d6437f540f2b448a32a7e4a
Associated tags:
- 20230512-143442
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-143442
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-143442].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7bf52830e76a35f46ecd0503273f384a13714eca8d6437f540f2b448a32a7e4a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230512142054]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9423460ad0ff2a95f4b3c6b760657ed9a9a8f78914aa1903fd08ba875a1aa170]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230512142054] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9423460ad0ff2a95f4b3c6b760657ed9a9a8f78914aa1903fd08ba875a1aa170])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9423460ad0ff2a95f4b3c6b760657ed9a9a8f78914aa1903fd08ba875a1aa170
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9423460ad0ff2a95f4b3c6b760657ed9a9a8f78914aa1903fd08ba875a1aa170].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512142054]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2785fd329e0aff8483a6c083a9a0f3c8667a5477adc95db3587945e8ac5c7e0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512142054] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2785fd329e0aff8483a6c083a9a0f3c8667a5477adc95db3587945e8ac5c7e0])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2785fd329e0aff8483a6c083a9a0f3c8667a5477adc95db3587945e8ac5c7e0
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2785fd329e0aff8483a6c083a9a0f3c8667a5477adc95db3587945e8ac5c7e0].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 48s
232 actionable tasks: 226 executed, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/5klafahag65lw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1625
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1625/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512082038",
"environmentId": "wMwQizweMNbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-083133"
}
]
},
"name": "go-testxlang_partition-373",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/12 09:16:18 Submitted job: 2023-05-12_02_16_17-9196656126909618729
2023/05/12 09:16:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-12_02_16_17-9196656126909618729?project=apache-beam-testing
2023/05/12 09:16:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-12_02_16_17-9196656126909618729
2023/05/12 09:16:18 Job state: JOB_STATE_PENDING ...
2023/05/12 09:16:48 Job still running ...
2023/05/12 09:17:18 Job still running ...
2023/05/12 09:17:48 Job still running ...
2023/05/12 09:18:18 Job still running ...
2023/05/12 09:18:48 Job still running ...
2023/05/12 09:19:18 Job still running ...
2023/05/12 09:19:48 Job still running ...
2023/05/12 09:20:18 Job still running ...
2023/05/12 09:20:48 Job still running ...
2023/05/12 09:21:18 Job still running ...
2023/05/12 09:21:48 Job still running ...
2023/05/12 09:22:18 Job still running ...
2023/05/12 09:22:48 Job still running ...
2023/05/12 09:23:18 Job still running ...
2023/05/12 09:23:48 Job still running ...
2023/05/12 09:24:18 Job still running ...
2023/05/12 09:24:48 Job still running ...
2023/05/12 09:25:18 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-12_02_16_17-9196656126909618729 failed
--- FAIL: TestXLang_Partition (582.73s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3218.313s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683880340404745758
--- FAIL: TestBigQueryIO_BasicWriteRead (4.72s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42487 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@SAfqEnlQtC" is_bounded:BOUNDED windowing_strategy_id:"w0@SAfqEnlQtC"}} windowing_strategies:{key:"w0@SAfqEnlQtC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@SAfqEnlQtC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@SAfqEnlQtC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@SAfqEnlQtC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683880340404745758\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"SAfqEnlQtC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42487 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@SAfqEnlQtC" is_bounded:BOUNDED windowing_strategy_id:"w0@SAfqEnlQtC"}} windowing_strategies:{key:"w0@SAfqEnlQtC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@SAfqEnlQtC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@SAfqEnlQtC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@SAfqEnlQtC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683880340404745758\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"SAfqEnlQtC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0004467c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0004467c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000e20a0?, 0xc0000e4000?}, {0x11c9c19, 0x39}, {0xc0000ea0c0?, 0x10c9440?, 0x41bc91?}, {0xc000045f40, 0xf}, 0xc0002d7d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000e2020?, 0xc0000e4000?}, {0xc000050960, 0x52}, {0x1?}, {0xc0002d7ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc000050960, 0x52}, {0xf25d40, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000d8d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000d8d00, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.744s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30f6df5e9dec515f1616cffbb985a0a074604ab31d09d288885bcb6e6c86fd49
Associated tags:
- 20230512-083133
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-083133
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230512-083133].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30f6df5e9dec515f1616cffbb985a0a074604ab31d09d288885bcb6e6c86fd49].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230512082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae759a195dc66f22e9b15518f6700198df87f98e8c756cfde744e2a01244171]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230512082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae759a195dc66f22e9b15518f6700198df87f98e8c756cfde744e2a01244171])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae759a195dc66f22e9b15518f6700198df87f98e8c756cfde744e2a01244171
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6ae759a195dc66f22e9b15518f6700198df87f98e8c756cfde744e2a01244171].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9e37b9f96df5829f4208c0af06f4364715c58cea00747f96d5f026a49ac0a87]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230512082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9e37b9f96df5829f4208c0af06f4364715c58cea00747f96d5f026a49ac0a87])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9e37b9f96df5829f4208c0af06f4364715c58cea00747f96d5f026a49ac0a87
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9e37b9f96df5829f4208c0af06f4364715c58cea00747f96d5f026a49ac0a87].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 36s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/hhufmllkc5rwg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1624
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1624/display/redirect>
Changes:
------------------------------------------
[...truncated 625.52 KB...]
#16 1.085 mmh3==3.1.0
#16 1.085 mock==5.0.1
#16 1.085 nltk==3.8.1
#16 1.085 nose==1.3.7
#16 1.085 numpy==1.23.5
#16 1.085 oauth2client==4.1.3
#16 1.085 oauthlib==3.2.2
#16 1.085 objsize==0.6.1
#16 1.085 opt-einsum==3.3.0
#16 1.085 orjson==3.8.9
#16 1.085 overrides==6.5.0
#16 1.085 packaging==23.0
#16 1.085 pandas==1.5.3
#16 1.085 parameterized==0.8.1
#16 1.085 pip==23.1.2
#16 1.085 pluggy==1.0.0
#16 1.085 proto-plus==1.22.2
#16 1.085 protobuf==4.22.1
#16 1.085 psycopg2-binary==2.9.6
#16 1.085 pyarrow==11.0.0
#16 1.085 pyasn1==0.4.8
#16 1.085 pyasn1-modules==0.2.8
#16 1.085 pycparser==2.21
#16 1.085 pydot==1.4.2
#16 1.085 PyHamcrest==1.10.1
#16 1.085 pymongo==4.3.3
#16 1.085 PyMySQL==1.0.3
#16 1.085 pyparsing==3.0.9
#16 1.085 pytest==7.2.2
#16 1.085 pytest-timeout==2.1.0
#16 1.085 pytest-xdist==3.2.1
#16 1.085 python-dateutil==2.8.2
#16 1.085 python-snappy==0.6.1
#16 1.085 pytz==2023.3
#16 1.085 PyYAML==6.0
#16 1.085 regex==2023.3.23
#16 1.085 requests==2.28.2
#16 1.085 requests-mock==1.10.0
#16 1.085 requests-oauthlib==1.3.1
#16 1.085 rsa==4.9
#16 1.085 scikit-learn==1.2.2
#16 1.085 scipy==1.10.1
#16 1.085 setuptools==67.7.2
#16 1.085 six==1.16.0
#16 1.085 sortedcontainers==2.4.0
#16 1.085 soupsieve==2.4
#16 1.085 SQLAlchemy==1.4.47
#16 1.085 sqlparse==0.4.3
#16 1.085 tenacity==8.2.2
#16 1.085 tensorboard==2.12.1
#16 1.085 tensorboard-data-server==0.7.0
#16 1.085 tensorboard-plugin-wit==1.8.1
#16 1.085 tensorflow==2.12.0
#16 1.085 tensorflow-estimator==2.12.0
#16 1.085 tensorflow-io-gcs-filesystem==0.32.0
#16 1.085 termcolor==2.2.0
#16 1.085 testcontainers==3.7.1
#16 1.085 threadpoolctl==3.1.0
#16 1.085 tomli==2.0.1
#16 1.085 tqdm==4.65.0
#16 1.085 typing_extensions==4.5.0
#16 1.085 urllib3==1.26.15
#16 1.085 websocket-client==1.5.1
#16 1.085 Werkzeug==2.2.3
#16 1.085 wheel==0.40.0
#16 1.085 wrapt==1.14.1
#16 1.085 zipp==3.15.0
#16 1.085 zstandard==0.20.0
#16 DONE 1.2s
#17 [beam 13/16] COPY target/LICENSE /opt/apache/beam/
#17 DONE 0.1s
#18 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/
#18 DONE 0.1s
#19 [beam 15/16] COPY target/NOTICE /opt/apache/beam/
#19 DONE 0.0s
#20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/
#20 DONE 0.2s
#21 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#21 DONE 0.0s
#22 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#22 DONE 0.1s
#23 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#23 DONE 0.1s
#24 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#24 1.220 Collecting pip-licenses<5
#24 1.306 Downloading pip_licenses-4.3.1-py3-none-any.whl (19 kB)
#24 1.318 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0)
#24 1.319 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#24 1.395 Collecting prettytable>=2.3.0 (from pip-licenses<5)
#24 1.418 Downloading prettytable-3.7.0-py3-none-any.whl (27 kB)
#24 1.487 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5)
#24 1.504 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#24 2.771 Installing collected packages: wcwidth, prettytable, pip-licenses
#24 2.943 Successfully installed pip-licenses-4.3.1 prettytable-3.7.0 wcwidth-0.2.6
#24 2.944 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#24 11.76 Skip pulling license for bs4
#24 11.76 INFO:root:Successfully pulled licenses for 133 dependencies
#24 DONE 11.9s
#25 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#25 DONE 0.1s
#26 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#26 DONE 0.4s
#27 exporting to image
#27 exporting layers
#27 exporting layers 15.4s done
#27 writing image sha256:44d1911239e3c71d70c4cd62c9b11a644da4277589e7d0e2ae456d0b8cf772c9 0.0s done
#27 naming to docker.io/apache/beam_python3.8_sdk:2.48.0.dev
#27 naming to docker.io/apache/beam_python3.8_sdk:2.48.0.dev done
#27 DONE 15.6s
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
80e17c360180: Preparing
e72cc53b17f9: Preparing
b651bfc43732: Preparing
e6a78f6b9088: Preparing
b0f1515d5939: Preparing
aed74bc044cf: Preparing
fa7a0d6ae84f: Preparing
1ede8ef53b77: Preparing
6ded221418c1: Preparing
ed9371e7ecc9: Preparing
d977f8b9eea1: Preparing
a2d8e345cfe9: Preparing
fd99613be0a7: Preparing
1c826c3a67d3: Preparing
1706688dad43: Preparing
80f99e991a73: Preparing
27e23752b4de: Preparing
0f01b683e005: Preparing
47b173d0dc6e: Preparing
554a219d41c5: Preparing
0007505dc811: Preparing
f43725f97b9f: Preparing
9c42af2c6418: Preparing
d96e248f10e6: Preparing
d925e0fae4e6: Preparing
d977f8b9eea1: Waiting
a2d8e345cfe9: Waiting
fd99613be0a7: Waiting
1c826c3a67d3: Waiting
27e23752b4de: Waiting
1706688dad43: Waiting
80f99e991a73: Waiting
0f01b683e005: Waiting
47b173d0dc6e: Waiting
554a219d41c5: Waiting
0007505dc811: Waiting
f43725f97b9f: Waiting
9c42af2c6418: Waiting
d96e248f10e6: Waiting
aed74bc044cf: Waiting
d925e0fae4e6: Waiting
1ede8ef53b77: Waiting
fa7a0d6ae84f: Waiting
ed9371e7ecc9: Waiting
b0f1515d5939: Pushed
e72cc53b17f9: Pushed
e6a78f6b9088: Pushed
80e17c360180: Pushed
b651bfc43732: Pushed
aed74bc044cf: Pushed
fa7a0d6ae84f: Pushed
1ede8ef53b77: Pushed
d977f8b9eea1: Pushed
a2d8e345cfe9: Pushed
ed9371e7ecc9: Pushed
1c826c3a67d3: Pushed
80f99e991a73: Pushed
0f01b683e005: Layer already exists
47b173d0dc6e: Layer already exists
554a219d41c5: Layer already exists
0007505dc811: Layer already exists
f43725f97b9f: Layer already exists
9c42af2c6418: Layer already exists
d96e248f10e6: Layer already exists
27e23752b4de: Pushed
d925e0fae4e6: Layer already exists
6ded221418c1: Pushed
fd99613be0a7: Pushed
1706688dad43: Pushed
20230512022041: digest: sha256:8b7f1e1b948fd020581f2f7b14cc8d09ec117aa16b52a2dcd1a6d2d1714d8114 size: 5563
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 11m 38s
223 actionable tasks: 143 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/cvepsjszxi6xq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1623
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1623/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511202034",
"environmentId": "qPVaDuayRhbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-203317"
}
]
},
"name": "go-testxlang_partition-34",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/11 21:16:54 Submitted job: 2023-05-11_14_16_53-2700038507150949488
2023/05/11 21:16:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-11_14_16_53-2700038507150949488?project=apache-beam-testing
2023/05/11 21:16:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-11_14_16_53-2700038507150949488
2023/05/11 21:16:54 Job state: JOB_STATE_PENDING ...
2023/05/11 21:17:24 Job still running ...
2023/05/11 21:17:54 Job still running ...
2023/05/11 21:18:24 Job still running ...
2023/05/11 21:18:54 Job still running ...
2023/05/11 21:19:24 Job still running ...
2023/05/11 21:19:54 Job still running ...
2023/05/11 21:20:24 Job still running ...
2023/05/11 21:20:54 Job still running ...
2023/05/11 21:21:24 Job still running ...
2023/05/11 21:21:54 Job still running ...
2023/05/11 21:22:24 Job still running ...
2023/05/11 21:22:54 Job still running ...
2023/05/11 21:23:24 Job still running ...
2023/05/11 21:23:54 Job still running ...
2023/05/11 21:24:24 Job still running ...
2023/05/11 21:24:54 Job still running ...
2023/05/11 21:25:24 Job still running ...
2023/05/11 21:25:54 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-11_14_16_53-2700038507150949488 failed
--- FAIL: TestXLang_Partition (580.26s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3151.491s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683837236706454557
--- FAIL: TestBigQueryIO_BasicWriteRead (5.16s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34771 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@wXEOWagFRs" is_bounded:BOUNDED windowing_strategy_id:"w0@wXEOWagFRs"}} windowing_strategies:{key:"w0@wXEOWagFRs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@wXEOWagFRs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@wXEOWagFRs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@wXEOWagFRs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683837236706454557\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"wXEOWagFRs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34771 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@wXEOWagFRs" is_bounded:BOUNDED windowing_strategy_id:"w0@wXEOWagFRs"}} windowing_strategies:{key:"w0@wXEOWagFRs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@wXEOWagFRs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@wXEOWagFRs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@wXEOWagFRs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683837236706454557\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"wXEOWagFRs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc000322740})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc000322740})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000700fe0?, 0xc000530410?}, {0x11c9c19, 0x39}, {0xc000158180?, 0x10c9440?, 0x1?}, {0xc000489f80, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000700f60?, 0xc000530410?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010ec00, 0x52}, {0xf25d40, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000351860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000351860, 0x11fd138)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.182s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:bf4b8272f62f38ea289604f5a4d51f0a35958e8aedc7ef2796993ecd40862d56
Associated tags:
- 20230511-203317
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-203317
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-203317].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:bf4b8272f62f38ea289604f5a4d51f0a35958e8aedc7ef2796993ecd40862d56].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511202034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b9c6f139cba9ceaad2af78ec34b24dc06860901c6f60eac573b32c066b3f11e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511202034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b9c6f139cba9ceaad2af78ec34b24dc06860901c6f60eac573b32c066b3f11e])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b9c6f139cba9ceaad2af78ec34b24dc06860901c6f60eac573b32c066b3f11e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b9c6f139cba9ceaad2af78ec34b24dc06860901c6f60eac573b32c066b3f11e].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511202034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1f55dec5153e45290440cd29744081630cee34a949c96e78cb014913bd929555]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511202034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1f55dec5153e45290440cd29744081630cee34a949c96e78cb014913bd929555])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1f55dec5153e45290440cd29744081630cee34a949c96e78cb014913bd929555
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1f55dec5153e45290440cd29744081630cee34a949c96e78cb014913bd929555].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 26s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/ozodcl5q6ga3e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1622
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1622/display/redirect?page=changes>
Changes:
[noreply] Add max/min batch size to tf model handlers (#26651)
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511142042",
"environmentId": "vqOnWHaMSUbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-143218"
}
]
},
"name": "go-testxlang_partition-588",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/11 15:17:26 Submitted job: 2023-05-11_08_17_26-11986224557126529371
2023/05/11 15:17:26 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-11_08_17_26-11986224557126529371?project=apache-beam-testing
2023/05/11 15:17:26 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-11_08_17_26-11986224557126529371
2023/05/11 15:17:26 Job state: JOB_STATE_PENDING ...
2023/05/11 15:17:56 Job still running ...
2023/05/11 15:18:26 Job still running ...
2023/05/11 15:18:56 Job still running ...
2023/05/11 15:19:26 Job still running ...
2023/05/11 15:19:56 Job still running ...
2023/05/11 15:20:26 Job still running ...
2023/05/11 15:20:57 Job still running ...
2023/05/11 15:21:27 Job still running ...
2023/05/11 15:21:57 Job still running ...
2023/05/11 15:22:27 Job still running ...
2023/05/11 15:22:57 Job still running ...
2023/05/11 15:23:27 Job still running ...
2023/05/11 15:23:57 Job still running ...
2023/05/11 15:24:27 Job still running ...
2023/05/11 15:24:57 Job still running ...
2023/05/11 15:25:27 Job still running ...
2023/05/11 15:25:57 Job still running ...
2023/05/11 15:26:27 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-11_08_17_26-11986224557126529371 failed
--- FAIL: TestXLang_Partition (581.94s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3247.754s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683815573688344997
--- FAIL: TestBigQueryIO_BasicWriteRead (4.94s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43655 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KjAwdashaH" is_bounded:BOUNDED windowing_strategy_id:"w0@KjAwdashaH"}} windowing_strategies:{key:"w0@KjAwdashaH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KjAwdashaH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KjAwdashaH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KjAwdashaH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683815573688344997\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KjAwdashaH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43655 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KjAwdashaH" is_bounded:BOUNDED windowing_strategy_id:"w0@KjAwdashaH"}} windowing_strategies:{key:"w0@KjAwdashaH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KjAwdashaH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KjAwdashaH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KjAwdashaH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683815573688344997\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KjAwdashaH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0004d6e80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0004d6e80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e100?, 0xc00060e000?}, {0x11c9c47, 0x39}, {0xc0000f6240?, 0x10c9440?, 0x41bc91?}, {0xc00046de10, 0xf}, 0xc000285d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e080?, 0xc00060e000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc000285ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d96c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d96c0, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.964s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.032s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-143218
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-143218
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:070d76cf97338f2d107920b2d497eefba4607d2d426af07040c0f9fd4940c384
Deleted: sha256:bd2176e69c21100fd3b26b47517eb91b0be6b84a5ba5e17f6257c870d1a3743a
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-143218
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:070d76cf97338f2d107920b2d497eefba4607d2d426af07040c0f9fd4940c384
Associated tags:
- 20230511-143218
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-143218
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-143218].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:070d76cf97338f2d107920b2d497eefba4607d2d426af07040c0f9fd4940c384].
$ rm -rf /tmp/tmp.yYiKVOiKsx
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511142042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:899e9a78add84d60b12a21cdc24546cf30b22dbf2eaeda798377ecb9f9e17e59
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511142042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:899e9a78add84d60b12a21cdc24546cf30b22dbf2eaeda798377ecb9f9e17e59]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511142042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:899e9a78add84d60b12a21cdc24546cf30b22dbf2eaeda798377ecb9f9e17e59])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:899e9a78add84d60b12a21cdc24546cf30b22dbf2eaeda798377ecb9f9e17e59
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:899e9a78add84d60b12a21cdc24546cf30b22dbf2eaeda798377ecb9f9e17e59
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:899e9a78add84d60b12a21cdc24546cf30b22dbf2eaeda798377ecb9f9e17e59].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511142042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1278e46e888399c7b02e446898f6313ef83848805a2fd00e5e252f143db1b7c
Deleted: sha256:dadb4a6bd83a8a13c9ca51b816664519e3dd249241f4fab4918c72499555e904
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511142042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1278e46e888399c7b02e446898f6313ef83848805a2fd00e5e252f143db1b7c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511142042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1278e46e888399c7b02e446898f6313ef83848805a2fd00e5e252f143db1b7c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1278e46e888399c7b02e446898f6313ef83848805a2fd00e5e252f143db1b7c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1278e46e888399c7b02e446898f6313ef83848805a2fd00e5e252f143db1b7c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1278e46e888399c7b02e446898f6313ef83848805a2fd00e5e252f143db1b7c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 134500.
Stopping expansion service pid: 134501.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 43s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/al3t53g2iefc4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1621
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1621/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511082044",
"environmentId": "TSiNNjCLGWbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-083223"
}
]
},
"name": "go-testxlang_partition-483",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/11 09:17:27 Submitted job: 2023-05-11_02_17_25-17570949366487604730
2023/05/11 09:17:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-11_02_17_25-17570949366487604730?project=apache-beam-testing
2023/05/11 09:17:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-11_02_17_25-17570949366487604730
2023/05/11 09:17:27 Job state: JOB_STATE_PENDING ...
2023/05/11 09:17:57 Job still running ...
2023/05/11 09:18:27 Job still running ...
2023/05/11 09:18:57 Job still running ...
2023/05/11 09:19:27 Job still running ...
2023/05/11 09:19:57 Job still running ...
2023/05/11 09:20:27 Job still running ...
2023/05/11 09:20:57 Job still running ...
2023/05/11 09:21:27 Job still running ...
2023/05/11 09:21:57 Job still running ...
2023/05/11 09:22:27 Job still running ...
2023/05/11 09:22:57 Job still running ...
2023/05/11 09:23:27 Job still running ...
2023/05/11 09:23:57 Job still running ...
2023/05/11 09:24:28 Job still running ...
2023/05/11 09:24:58 Job still running ...
2023/05/11 09:25:28 Job still running ...
2023/05/11 09:25:58 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-11_02_17_25-17570949366487604730 failed
--- FAIL: TestXLang_Partition (551.33s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3211.564s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683793980075704409
--- FAIL: TestBigQueryIO_BasicWriteRead (5.13s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34029 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@nFcEBjYesT" is_bounded:BOUNDED windowing_strategy_id:"w0@nFcEBjYesT"}} windowing_strategies:{key:"w0@nFcEBjYesT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@nFcEBjYesT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@nFcEBjYesT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@nFcEBjYesT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683793980075704409\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"nFcEBjYesT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34029 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@nFcEBjYesT" is_bounded:BOUNDED windowing_strategy_id:"w0@nFcEBjYesT"}} windowing_strategies:{key:"w0@nFcEBjYesT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@nFcEBjYesT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@nFcEBjYesT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@nFcEBjYesT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683793980075704409\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"nFcEBjYesT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0004d01c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0004d01c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1e0?, 0xc0000c4280?}, {0x11c9c47, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc0006b1d10, 0xf}, 0xc000573d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc0000c4280?}, {0xc0006a67e0, 0x52}, {0x1?}, {0xc000573ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0006b1d10, 0xf}, {0xc0006a67e0, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00048bd40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00048bd40, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.159s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.037s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-083223
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-083223
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d16af669ae0186dfa9a6b6cf2afa55799fd8024fb5895c8384ac7759b80bf9bc
Deleted: sha256:07964287b8e68826bea2e5b1679a6f269f096a67eb1d345813ae72b44af5f5be
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-083223
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d16af669ae0186dfa9a6b6cf2afa55799fd8024fb5895c8384ac7759b80bf9bc
Associated tags:
- 20230511-083223
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-083223
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-083223].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d16af669ae0186dfa9a6b6cf2afa55799fd8024fb5895c8384ac7759b80bf9bc].
$ rm -rf /tmp/tmp.gyQPupdKUA
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511082044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ecd11ad15d77679cf76954adcb4f9caaba2d9962489b2dbabd7bb4b9b92a007
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511082044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ecd11ad15d77679cf76954adcb4f9caaba2d9962489b2dbabd7bb4b9b92a007]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511082044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ecd11ad15d77679cf76954adcb4f9caaba2d9962489b2dbabd7bb4b9b92a007])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ecd11ad15d77679cf76954adcb4f9caaba2d9962489b2dbabd7bb4b9b92a007
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ecd11ad15d77679cf76954adcb4f9caaba2d9962489b2dbabd7bb4b9b92a007
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9ecd11ad15d77679cf76954adcb4f9caaba2d9962489b2dbabd7bb4b9b92a007].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511082044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bf578b4cafc10b3953aaa29e46c9b8892b516b08c6962bc07c5f6a9f3c1f395
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511082044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bf578b4cafc10b3953aaa29e46c9b8892b516b08c6962bc07c5f6a9f3c1f395]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511082044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bf578b4cafc10b3953aaa29e46c9b8892b516b08c6962bc07c5f6a9f3c1f395])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bf578b4cafc10b3953aaa29e46c9b8892b516b08c6962bc07c5f6a9f3c1f395
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bf578b4cafc10b3953aaa29e46c9b8892b516b08c6962bc07c5f6a9f3c1f395
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bf578b4cafc10b3953aaa29e46c9b8892b516b08c6962bc07c5f6a9f3c1f395].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4125747.
Stopping expansion service pid: 4125748.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 13s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/5wzqxuotst6da
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1620
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1620/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511022046",
"environmentId": "WQUbgmTvkabeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-023253"
}
]
},
"name": "go-testxlang_partition-135",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/11 03:19:25 Submitted job: 2023-05-10_20_19_25-11674205650142158701
2023/05/11 03:19:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-10_20_19_25-11674205650142158701?project=apache-beam-testing
2023/05/11 03:19:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-10_20_19_25-11674205650142158701
2023/05/11 03:19:25 Job state: JOB_STATE_PENDING ...
2023/05/11 03:19:56 Job still running ...
2023/05/11 03:20:26 Job still running ...
2023/05/11 03:20:56 Job still running ...
2023/05/11 03:21:26 Job still running ...
2023/05/11 03:21:56 Job still running ...
2023/05/11 03:22:26 Job still running ...
2023/05/11 03:22:56 Job still running ...
2023/05/11 03:23:26 Job still running ...
2023/05/11 03:23:56 Job still running ...
2023/05/11 03:24:26 Job still running ...
2023/05/11 03:24:56 Job still running ...
2023/05/11 03:25:26 Job still running ...
2023/05/11 03:25:56 Job still running ...
2023/05/11 03:26:26 Job still running ...
2023/05/11 03:26:56 Job still running ...
2023/05/11 03:27:26 Job still running ...
2023/05/11 03:27:56 Job still running ...
2023/05/11 03:28:26 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-10_20_19_25-11674205650142158701 failed
--- FAIL: TestXLang_Partition (580.84s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3330.500s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683772409784010467
--- FAIL: TestBigQueryIO_BasicWriteRead (5.09s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39861 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JSvAVurZuq" is_bounded:BOUNDED windowing_strategy_id:"w0@JSvAVurZuq"}} windowing_strategies:{key:"w0@JSvAVurZuq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JSvAVurZuq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JSvAVurZuq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JSvAVurZuq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683772409784010467\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JSvAVurZuq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39861 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JSvAVurZuq" is_bounded:BOUNDED windowing_strategy_id:"w0@JSvAVurZuq"}} windowing_strategies:{key:"w0@JSvAVurZuq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JSvAVurZuq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JSvAVurZuq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JSvAVurZuq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683772409784010467\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JSvAVurZuq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc000486380})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc000486380})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1e0?, 0xc000722000?}, {0x11c9c47, 0x39}, {0xc0000f6240?, 0x10c9440?, 0x41bc91?}, {0xc000137cc0, 0xf}, 0xc000575d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc000722000?}, {0xc0007106c0, 0x52}, {0x1?}, {0xc000575ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000137cc0, 0xf}, {0xc0007106c0, 0x52}, {0xf25d40, 0xc00059e048})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103ba0, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.123s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.037s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-023253
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-023253
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b34258ddc1183afe101c4944eff5225f8a894b7cf1e855c50bf167ff447208d5
Deleted: sha256:aa12ed55e4d155fcb2cf952fcea2179deb3b364753b544fc90ab702525e7a7e5
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-023253
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b34258ddc1183afe101c4944eff5225f8a894b7cf1e855c50bf167ff447208d5
Associated tags:
- 20230511-023253
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-023253
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230511-023253].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b34258ddc1183afe101c4944eff5225f8a894b7cf1e855c50bf167ff447208d5].
$ rm -rf /tmp/tmp.gwxNUKK4Gz
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511022046
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:abed153b22a28ad28b8b6ec5f290ae61b63cc9af2d4bb232f908d78226db4b38
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511022046]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:abed153b22a28ad28b8b6ec5f290ae61b63cc9af2d4bb232f908d78226db4b38]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230511022046] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:abed153b22a28ad28b8b6ec5f290ae61b63cc9af2d4bb232f908d78226db4b38])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:abed153b22a28ad28b8b6ec5f290ae61b63cc9af2d4bb232f908d78226db4b38
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:abed153b22a28ad28b8b6ec5f290ae61b63cc9af2d4bb232f908d78226db4b38
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:abed153b22a28ad28b8b6ec5f290ae61b63cc9af2d4bb232f908d78226db4b38].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511022046
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a8f38a5d81397780223e8c86f6e40c0e79c38659df8acef75d1edcea352a33
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511022046]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a8f38a5d81397780223e8c86f6e40c0e79c38659df8acef75d1edcea352a33]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230511022046] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a8f38a5d81397780223e8c86f6e40c0e79c38659df8acef75d1edcea352a33])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a8f38a5d81397780223e8c86f6e40c0e79c38659df8acef75d1edcea352a33
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a8f38a5d81397780223e8c86f6e40c0e79c38659df8acef75d1edcea352a33
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a8f38a5d81397780223e8c86f6e40c0e79c38659df8acef75d1edcea352a33].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3930472.
Stopping expansion service pid: 3930473.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 45s
232 actionable tasks: 154 executed, 66 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/yrhscmy33szym
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1619
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1619/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510202032",
"environmentId": "YwdGNpLRhvbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-203328"
}
]
},
"name": "go-testxlang_partition-451",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/10 21:19:02 Submitted job: 2023-05-10_14_19_01-5682845592190870966
2023/05/10 21:19:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-10_14_19_01-5682845592190870966?project=apache-beam-testing
2023/05/10 21:19:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-10_14_19_01-5682845592190870966
2023/05/10 21:19:02 Job state: JOB_STATE_PENDING ...
2023/05/10 21:19:32 Job still running ...
2023/05/10 21:20:02 Job still running ...
2023/05/10 21:20:32 Job still running ...
2023/05/10 21:21:02 Job still running ...
2023/05/10 21:21:32 Job still running ...
2023/05/10 21:22:02 Job still running ...
2023/05/10 21:22:32 Job still running ...
2023/05/10 21:23:02 Job still running ...
2023/05/10 21:23:32 Job still running ...
2023/05/10 21:24:02 Job still running ...
2023/05/10 21:24:32 Job still running ...
2023/05/10 21:25:02 Job still running ...
2023/05/10 21:25:32 Job still running ...
2023/05/10 21:26:02 Job still running ...
2023/05/10 21:26:33 Job still running ...
2023/05/10 21:27:03 Job still running ...
2023/05/10 21:27:33 Job still running ...
2023/05/10 21:28:03 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-10_14_19_01-5682845592190870966 failed
--- FAIL: TestXLang_Partition (580.55s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3272.055s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683750844666393413
--- FAIL: TestBigQueryIO_BasicWriteRead (4.85s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35765 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hTHCEPGmzW" is_bounded:BOUNDED windowing_strategy_id:"w0@hTHCEPGmzW"}} windowing_strategies:{key:"w0@hTHCEPGmzW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hTHCEPGmzW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hTHCEPGmzW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hTHCEPGmzW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683750844666393413\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hTHCEPGmzW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35765 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hTHCEPGmzW" is_bounded:BOUNDED windowing_strategy_id:"w0@hTHCEPGmzW"}} windowing_strategies:{key:"w0@hTHCEPGmzW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hTHCEPGmzW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hTHCEPGmzW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hTHCEPGmzW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683750844666393413\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hTHCEPGmzW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 51 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0002ae640})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0002ae640})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006d80a0?, 0xc0000c4280?}, {0x11c9c47, 0x39}, {0xc0000ee180?, 0x10c9440?, 0x41bc91?}, {0xc000465e60, 0xf}, 0xc0005f9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006d8020?, 0xc0000c4280?}, {0xc00010e7e0, 0x52}, {0x1?}, {0xc0005f9ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000465e60, 0xf}, {0xc00010e7e0, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2d00, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.883s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:04de24617cf4033b21198ebfe75b977da0febc5a4838e4192cafddd569491f9c
Associated tags:
- 20230510-203328
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-203328
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-203328].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:04de24617cf4033b21198ebfe75b977da0febc5a4838e4192cafddd569491f9c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510202032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9e7f577af10494d282cfe1ec9e47dc3ce5fff706edcad20ac37e7f648d0a0481]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510202032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9e7f577af10494d282cfe1ec9e47dc3ce5fff706edcad20ac37e7f648d0a0481])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9e7f577af10494d282cfe1ec9e47dc3ce5fff706edcad20ac37e7f648d0a0481
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9e7f577af10494d282cfe1ec9e47dc3ce5fff706edcad20ac37e7f648d0a0481].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510202032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7aae8c4786682dda6c4e6519251dcd08e5d0cc352e9891efc3c9ef9cf76a9b0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510202032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7aae8c4786682dda6c4e6519251dcd08e5d0cc352e9891efc3c9ef9cf76a9b0])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7aae8c4786682dda6c4e6519251dcd08e5d0cc352e9891efc3c9ef9cf76a9b0
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7aae8c4786682dda6c4e6519251dcd08e5d0cc352e9891efc3c9ef9cf76a9b0].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 30s
232 actionable tasks: 161 executed, 59 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/w6mh2ejplaxre
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1618
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1618/display/redirect?page=changes>
Changes:
[noreply] Use default value for pg_router_host if it's not specified (#26629)
------------------------------------------
[...truncated 1.03 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510142042",
"environmentId": "EJaoJxmUribeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-143138"
}
]
},
"name": "go-testxlang_partition-180",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/10 15:17:18 Submitted job: 2023-05-10_08_17_17-3243324603076551892
2023/05/10 15:17:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-10_08_17_17-3243324603076551892?project=apache-beam-testing
2023/05/10 15:17:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-10_08_17_17-3243324603076551892
2023/05/10 15:17:18 Job state: JOB_STATE_PENDING ...
2023/05/10 15:17:48 Job still running ...
2023/05/10 15:18:18 Job still running ...
2023/05/10 15:18:48 Job still running ...
2023/05/10 15:19:18 Job still running ...
2023/05/10 15:19:48 Job still running ...
2023/05/10 15:20:19 Job still running ...
2023/05/10 15:20:49 Job still running ...
2023/05/10 15:21:19 Job still running ...
2023/05/10 15:21:49 Job still running ...
2023/05/10 15:22:19 Job still running ...
2023/05/10 15:22:49 Job still running ...
2023/05/10 15:23:19 Job still running ...
2023/05/10 15:23:49 Job still running ...
2023/05/10 15:24:19 Job still running ...
2023/05/10 15:24:49 Job still running ...
2023/05/10 15:25:19 Job still running ...
2023/05/10 15:25:49 Job still running ...
2023/05/10 15:26:19 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-10_08_17_17-3243324603076551892 failed
--- FAIL: TestXLang_Partition (583.53s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3277.444s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683729136101920351
--- FAIL: TestBigQueryIO_BasicWriteRead (5.38s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43145 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KJXwJaAxpW" is_bounded:BOUNDED windowing_strategy_id:"w0@KJXwJaAxpW"}} windowing_strategies:{key:"w0@KJXwJaAxpW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KJXwJaAxpW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KJXwJaAxpW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KJXwJaAxpW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683729136101920351\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KJXwJaAxpW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43145 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KJXwJaAxpW" is_bounded:BOUNDED windowing_strategy_id:"w0@KJXwJaAxpW"}} windowing_strategies:{key:"w0@KJXwJaAxpW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KJXwJaAxpW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KJXwJaAxpW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KJXwJaAxpW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683729136101920351\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KJXwJaAxpW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc000334780})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc000334780})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000aef80?, 0xc0000c4460?}, {0x11c9c47, 0x39}, {0xc000158180?, 0x10c9440?, 0x1?}, {0xc000489f80, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000aef00?, 0xc0000c4460?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010ec00, 0x52}, {0xf25d40, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503860, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.416s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.038s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-143138
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-143138
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:651377ffd19bd3e41f305dc2b5b8582a64a109082abf9ff8fcb6f72e23c5ab6f
Deleted: sha256:d0850feed832b059cdfea13eeb372b469fe17c2d70af85e3fb1ecbaea00f9df7
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-143138
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:651377ffd19bd3e41f305dc2b5b8582a64a109082abf9ff8fcb6f72e23c5ab6f
Associated tags:
- 20230510-143138
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-143138
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-143138].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:651377ffd19bd3e41f305dc2b5b8582a64a109082abf9ff8fcb6f72e23c5ab6f].
$ rm -rf /tmp/tmp.d6diwIWSqf
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510142042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:08f31e9a6e0615394bf3212f315fc15d29de73abb80f2ee4b5042dad05721463
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510142042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:08f31e9a6e0615394bf3212f315fc15d29de73abb80f2ee4b5042dad05721463]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510142042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:08f31e9a6e0615394bf3212f315fc15d29de73abb80f2ee4b5042dad05721463])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:08f31e9a6e0615394bf3212f315fc15d29de73abb80f2ee4b5042dad05721463
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:08f31e9a6e0615394bf3212f315fc15d29de73abb80f2ee4b5042dad05721463
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:08f31e9a6e0615394bf3212f315fc15d29de73abb80f2ee4b5042dad05721463].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510142042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:47e0784580d126ef590970a66828efefffbe2f1f439a750d430ab0631282a522
Deleted: sha256:02c4bc31328bb55c06c2f832fb9b11ec6993433e6127d8a80cf184e66c2785ee
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510142042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:47e0784580d126ef590970a66828efefffbe2f1f439a750d430ab0631282a522]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510142042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:47e0784580d126ef590970a66828efefffbe2f1f439a750d430ab0631282a522])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:47e0784580d126ef590970a66828efefffbe2f1f439a750d430ab0631282a522
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:47e0784580d126ef590970a66828efefffbe2f1f439a750d430ab0631282a522
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:47e0784580d126ef590970a66828efefffbe2f1f439a750d430ab0631282a522].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3429957.
Stopping expansion service pid: 3429958.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 37s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/6tej4pm2bmq2s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1617
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1617/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510082046",
"environmentId": "LPizSsfsHwbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-083243"
}
]
},
"name": "go-testxlang_partition-420",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/10 09:18:07 Submitted job: 2023-05-10_02_18_06-17851624740856030878
2023/05/10 09:18:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-10_02_18_06-17851624740856030878?project=apache-beam-testing
2023/05/10 09:18:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-10_02_18_06-17851624740856030878
2023/05/10 09:18:07 Job state: JOB_STATE_PENDING ...
2023/05/10 09:18:37 Job still running ...
2023/05/10 09:19:07 Job still running ...
2023/05/10 09:19:37 Job still running ...
2023/05/10 09:20:07 Job still running ...
2023/05/10 09:20:37 Job still running ...
2023/05/10 09:21:07 Job still running ...
2023/05/10 09:21:37 Job still running ...
2023/05/10 09:22:07 Job still running ...
2023/05/10 09:22:37 Job still running ...
2023/05/10 09:23:07 Job still running ...
2023/05/10 09:23:37 Job still running ...
2023/05/10 09:24:07 Job still running ...
2023/05/10 09:24:37 Job still running ...
2023/05/10 09:25:07 Job still running ...
2023/05/10 09:25:37 Job still running ...
2023/05/10 09:26:07 Job still running ...
2023/05/10 09:26:37 Job still running ...
2023/05/10 09:27:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-10_02_18_06-17851624740856030878 failed
--- FAIL: TestXLang_Partition (580.60s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3258.030s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683707603863065037
--- FAIL: TestBigQueryIO_BasicWriteRead (4.93s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43999 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dgeXubfayK" is_bounded:BOUNDED windowing_strategy_id:"w0@dgeXubfayK"}} windowing_strategies:{key:"w0@dgeXubfayK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dgeXubfayK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dgeXubfayK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dgeXubfayK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683707603863065037\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dgeXubfayK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43999 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dgeXubfayK" is_bounded:BOUNDED windowing_strategy_id:"w0@dgeXubfayK"}} windowing_strategies:{key:"w0@dgeXubfayK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dgeXubfayK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dgeXubfayK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dgeXubfayK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683707603863065037\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dgeXubfayK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 21 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0004d6e80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0004d6e80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005300a0?, 0xc000532000?}, {0x11c9c47, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00046de10, 0xf}, 0xc000219d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000530020?, 0xc000532000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc000219ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000582820)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000582820, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.961s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-083243
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-083243
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c4b7c50ecd34ad3cf42363186c22e65d163231c86315be962666f1de5b451a32
Deleted: sha256:3ed56e0b1d10eb53fb388806822533da3605845a316e9e2a97af76f8886ee014
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-083243
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c4b7c50ecd34ad3cf42363186c22e65d163231c86315be962666f1de5b451a32
Associated tags:
- 20230510-083243
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-083243
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-083243].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c4b7c50ecd34ad3cf42363186c22e65d163231c86315be962666f1de5b451a32].
$ rm -rf /tmp/tmp.A5QI7AMuGd
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510082046
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bb8214aad7e55a7ac22acb465e54b369ef1270f5c8fba7de495b43e92d65ea96
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510082046]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bb8214aad7e55a7ac22acb465e54b369ef1270f5c8fba7de495b43e92d65ea96]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510082046] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bb8214aad7e55a7ac22acb465e54b369ef1270f5c8fba7de495b43e92d65ea96])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bb8214aad7e55a7ac22acb465e54b369ef1270f5c8fba7de495b43e92d65ea96
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bb8214aad7e55a7ac22acb465e54b369ef1270f5c8fba7de495b43e92d65ea96
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bb8214aad7e55a7ac22acb465e54b369ef1270f5c8fba7de495b43e92d65ea96].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510082046
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bfd181b685b4e7f5862cfb957ec25e4d63246af7bf3e548b637fab2f2f8d4018
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510082046]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bfd181b685b4e7f5862cfb957ec25e4d63246af7bf3e548b637fab2f2f8d4018]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510082046] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bfd181b685b4e7f5862cfb957ec25e4d63246af7bf3e548b637fab2f2f8d4018])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bfd181b685b4e7f5862cfb957ec25e4d63246af7bf3e548b637fab2f2f8d4018
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bfd181b685b4e7f5862cfb957ec25e4d63246af7bf3e548b637fab2f2f8d4018
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bfd181b685b4e7f5862cfb957ec25e4d63246af7bf3e548b637fab2f2f8d4018].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2945284.
Stopping expansion service pid: 2945285.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 24s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/uwo3cyjdy373m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1616
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1616/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510022045",
"environmentId": "XSTqTyPCLibeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-023251"
}
]
},
"name": "go-testxlang_partition-305",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/10 03:17:58 Submitted job: 2023-05-09_20_17_57-9286288006849382286
2023/05/10 03:17:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-09_20_17_57-9286288006849382286?project=apache-beam-testing
2023/05/10 03:17:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-09_20_17_57-9286288006849382286
2023/05/10 03:17:58 Job state: JOB_STATE_PENDING ...
2023/05/10 03:18:28 Job still running ...
2023/05/10 03:18:58 Job still running ...
2023/05/10 03:19:28 Job still running ...
2023/05/10 03:19:58 Job still running ...
2023/05/10 03:20:28 Job still running ...
2023/05/10 03:20:58 Job still running ...
2023/05/10 03:21:28 Job still running ...
2023/05/10 03:21:58 Job still running ...
2023/05/10 03:22:28 Job still running ...
2023/05/10 03:22:58 Job still running ...
2023/05/10 03:23:28 Job still running ...
2023/05/10 03:23:58 Job still running ...
2023/05/10 03:24:28 Job still running ...
2023/05/10 03:24:58 Job still running ...
2023/05/10 03:25:28 Job still running ...
2023/05/10 03:25:58 Job still running ...
2023/05/10 03:26:29 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-09_20_17_57-9286288006849382286 failed
--- FAIL: TestXLang_Partition (550.96s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3209.598s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683686014023851643
--- FAIL: TestBigQueryIO_BasicWriteRead (5.45s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34335 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YZLRpPDzPg" is_bounded:BOUNDED windowing_strategy_id:"w0@YZLRpPDzPg"}} windowing_strategies:{key:"w0@YZLRpPDzPg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YZLRpPDzPg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YZLRpPDzPg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YZLRpPDzPg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683686014023851643\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YZLRpPDzPg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34335 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YZLRpPDzPg" is_bounded:BOUNDED windowing_strategy_id:"w0@YZLRpPDzPg"}} windowing_strategies:{key:"w0@YZLRpPDzPg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YZLRpPDzPg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YZLRpPDzPg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YZLRpPDzPg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683686014023851643\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YZLRpPDzPg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3061)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2110)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:479)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:352)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:228)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:193)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:545)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:496)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00021eb00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00021eb00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005980a0?, 0xc00059e000?}, {0x11c9c47, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00046dee0, 0xf}, 0xc00011fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000598020?, 0xc00059e000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc00011fea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dee0, 0xf}, {0xc000050ea0, 0x52}, {0xf25d40, 0xc00059a008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000581040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000581040, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.480s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.038s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:52ca5cf08243e177b0e769d9f42b91164e7f180e6da800a171f2c72683ce4df4
Associated tags:
- 20230510-023251
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-023251
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230510-023251].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:52ca5cf08243e177b0e769d9f42b91164e7f180e6da800a171f2c72683ce4df4].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510022045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:61fe412927f197fae329e7c89a1828e3d6689168a1675dc01fd9af2619a61039]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230510022045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:61fe412927f197fae329e7c89a1828e3d6689168a1675dc01fd9af2619a61039])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:61fe412927f197fae329e7c89a1828e3d6689168a1675dc01fd9af2619a61039
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:61fe412927f197fae329e7c89a1828e3d6689168a1675dc01fd9af2619a61039].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510022045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0177b67f762a678888d1963cdbbe01bd9bbf9a317f167fb9c966f2f6ac6c4be3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230510022045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0177b67f762a678888d1963cdbbe01bd9bbf9a317f167fb9c966f2f6ac6c4be3])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0177b67f762a678888d1963cdbbe01bd9bbf9a317f167fb9c966f2f6ac6c4be3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0177b67f762a678888d1963cdbbe01bd9bbf9a317f167fb9c966f2f6ac6c4be3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 46s
232 actionable tasks: 171 executed, 50 from cache, 11 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/6i25kbxr6ytfe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1615
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1615/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509202129",
"environmentId": "ZqpTAJOQSHbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-203229"
}
]
},
"name": "go-testxlang_partition-823",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/09 21:17:33 Submitted job: 2023-05-09_14_17_33-8250835724157319567
2023/05/09 21:17:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-09_14_17_33-8250835724157319567?project=apache-beam-testing
2023/05/09 21:17:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-09_14_17_33-8250835724157319567
2023/05/09 21:17:33 Job state: JOB_STATE_PENDING ...
2023/05/09 21:18:03 Job still running ...
2023/05/09 21:18:33 Job still running ...
2023/05/09 21:19:03 Job still running ...
2023/05/09 21:19:33 Job still running ...
2023/05/09 21:20:04 Job still running ...
2023/05/09 21:20:34 Job still running ...
2023/05/09 21:21:04 Job still running ...
2023/05/09 21:21:34 Job still running ...
2023/05/09 21:22:04 Job still running ...
2023/05/09 21:22:34 Job still running ...
2023/05/09 21:23:04 Job still running ...
2023/05/09 21:23:34 Job still running ...
2023/05/09 21:24:04 Job still running ...
2023/05/09 21:24:34 Job still running ...
2023/05/09 21:25:04 Job still running ...
2023/05/09 21:25:34 Job still running ...
2023/05/09 21:26:04 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-09_14_17_33-8250835724157319567 failed
--- FAIL: TestXLang_Partition (550.32s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3209.898s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683664388127286626
--- FAIL: TestBigQueryIO_BasicWriteRead (4.87s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43139 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LHQxTIdTZG" is_bounded:BOUNDED windowing_strategy_id:"w0@LHQxTIdTZG"}} windowing_strategies:{key:"w0@LHQxTIdTZG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LHQxTIdTZG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LHQxTIdTZG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LHQxTIdTZG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683664388127286626\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LHQxTIdTZG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43139 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LHQxTIdTZG" is_bounded:BOUNDED windowing_strategy_id:"w0@LHQxTIdTZG"}} windowing_strategies:{key:"w0@LHQxTIdTZG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LHQxTIdTZG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LHQxTIdTZG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LHQxTIdTZG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683664388127286626\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LHQxTIdTZG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0002c6bc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0002c6bc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1e0?, 0xc0000c4280?}, {0x11c9c47, 0x39}, {0xc0005fc0c0?, 0x10c9440?, 0x41bc91?}, {0xc00046de10, 0xf}, 0xc000575d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc0000c4280?}, {0xc000050f00, 0x52}, {0x1?}, {0xc000575ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050f00, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000602d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000602d00, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.905s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:44e1d6b729d2ed49adb139ab7cd5a55666f28c15adba92519e7f4217cecdd922
Associated tags:
- 20230509-203229
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-203229
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-203229].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:44e1d6b729d2ed49adb139ab7cd5a55666f28c15adba92519e7f4217cecdd922].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509202129]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbd5368556ee080d47f06da3c97e2dfed88f0f0f327f9841e4c424fdeaa36628]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509202129] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbd5368556ee080d47f06da3c97e2dfed88f0f0f327f9841e4c424fdeaa36628])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbd5368556ee080d47f06da3c97e2dfed88f0f0f327f9841e4c424fdeaa36628
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbd5368556ee080d47f06da3c97e2dfed88f0f0f327f9841e4c424fdeaa36628].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509202129]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f03043821bbe380603ad4f77f73b37aad81d374c739a9daec6762de429335e56]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509202129] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f03043821bbe380603ad4f77f73b37aad81d374c739a9daec6762de429335e56])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f03043821bbe380603ad4f77f73b37aad81d374c739a9daec6762de429335e56
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f03043821bbe380603ad4f77f73b37aad81d374c739a9daec6762de429335e56].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 34s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/tbbv3ny63yq4c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1614
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1614/display/redirect?page=changes>
Changes:
[noreply] [release] Improve Java Artifact Validation Logic (#26564)
------------------------------------------
[...truncated 1.04 MB...]
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509142044",
"environmentId": "hvSnWqkyXFbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-143220"
}
]
},
"name": "go-testxlang_partition-283",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/09 15:17:55 Submitted job: 2023-05-09_08_17_54-13741640304835111436
2023/05/09 15:17:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-09_08_17_54-13741640304835111436?project=apache-beam-testing
2023/05/09 15:17:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-09_08_17_54-13741640304835111436
2023/05/09 15:17:55 Job state: JOB_STATE_PENDING ...
2023/05/09 15:18:25 Job still running ...
2023/05/09 15:18:55 Job still running ...
2023/05/09 15:19:25 Job still running ...
2023/05/09 15:19:55 Job still running ...
2023/05/09 15:20:25 Job still running ...
2023/05/09 15:20:55 Job still running ...
2023/05/09 15:21:25 Job still running ...
2023/05/09 15:21:55 Job still running ...
2023/05/09 15:22:25 Job still running ...
2023/05/09 15:22:55 Job still running ...
2023/05/09 15:23:25 Job still running ...
2023/05/09 15:23:55 Job still running ...
2023/05/09 15:24:25 Job still running ...
2023/05/09 15:24:55 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-09_08_17_54-13741640304835111436 failed
--- FAIL: TestXLang_Partition (461.16s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3153.083s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683642776143434389
--- FAIL: TestBigQueryIO_BasicWriteRead (4.95s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42345 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@VHcOMAoeLH" is_bounded:BOUNDED windowing_strategy_id:"w0@VHcOMAoeLH"}} windowing_strategies:{key:"w0@VHcOMAoeLH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@VHcOMAoeLH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@VHcOMAoeLH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@VHcOMAoeLH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683642776143434389\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"VHcOMAoeLH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42345 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@VHcOMAoeLH" is_bounded:BOUNDED windowing_strategy_id:"w0@VHcOMAoeLH"}} windowing_strategies:{key:"w0@VHcOMAoeLH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@VHcOMAoeLH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@VHcOMAoeLH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@VHcOMAoeLH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683642776143434389\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"VHcOMAoeLH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0004e8b40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0004e8b40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005660a0?, 0xc000568000?}, {0x11c9c47, 0x39}, {0xc0001c4180?, 0x10c9440?, 0x41bc91?}, {0xc0004f7f80, 0xf}, 0xc000395d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000566020?, 0xc000568000?}, {0xc00019aba0, 0x52}, {0x1?}, {0xc000395ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0004f7f80, 0xf}, {0xc00019aba0, 0x52}, {0xf25d40, 0xc000198078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000505ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000505ba0, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.973s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:37e7b662cb92b8943b9bba843cb1162bd7fc757bfdd60ec94b8e5a73a3745a3c
Associated tags:
- 20230509-143220
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-143220
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-143220].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:37e7b662cb92b8943b9bba843cb1162bd7fc757bfdd60ec94b8e5a73a3745a3c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49d4ed0f14c74496d01e75ab0cb04a414d3dadd3a2c6a0c1610f3bca02ca98f8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49d4ed0f14c74496d01e75ab0cb04a414d3dadd3a2c6a0c1610f3bca02ca98f8])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49d4ed0f14c74496d01e75ab0cb04a414d3dadd3a2c6a0c1610f3bca02ca98f8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49d4ed0f14c74496d01e75ab0cb04a414d3dadd3a2c6a0c1610f3bca02ca98f8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ea927ae540328b03b77743bf4be5438ec605ba634d1e82f7d1bfa9184a8ccb74]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ea927ae540328b03b77743bf4be5438ec605ba634d1e82f7d1bfa9184a8ccb74])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ea927ae540328b03b77743bf4be5438ec605ba634d1e82f7d1bfa9184a8ccb74
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ea927ae540328b03b77743bf4be5438ec605ba634d1e82f7d1bfa9184a8ccb74].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 11s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/t76vspsu73uk2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1613
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1613/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509082027",
"environmentId": "dGAYugiIxpbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-083038"
}
]
},
"name": "go-testxlang_partition-984",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/09 09:14:35 Submitted job: 2023-05-09_02_14_34-3369907989558026462
2023/05/09 09:14:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-09_02_14_34-3369907989558026462?project=apache-beam-testing
2023/05/09 09:14:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-09_02_14_34-3369907989558026462
2023/05/09 09:14:35 Job state: JOB_STATE_PENDING ...
2023/05/09 09:15:05 Job still running ...
2023/05/09 09:15:35 Job still running ...
2023/05/09 09:16:05 Job still running ...
2023/05/09 09:16:35 Job still running ...
2023/05/09 09:17:05 Job still running ...
2023/05/09 09:17:35 Job still running ...
2023/05/09 09:18:05 Job still running ...
2023/05/09 09:18:35 Job still running ...
2023/05/09 09:19:05 Job still running ...
2023/05/09 09:19:35 Job still running ...
2023/05/09 09:20:05 Job still running ...
2023/05/09 09:20:36 Job still running ...
2023/05/09 09:21:06 Job still running ...
2023/05/09 09:21:36 Job still running ...
2023/05/09 09:22:06 Job still running ...
2023/05/09 09:22:36 Job still running ...
2023/05/09 09:23:06 Job still running ...
2023/05/09 09:23:36 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-09_02_14_34-3369907989558026462 failed
--- FAIL: TestXLang_Partition (580.56s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3178.748s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683621070934054466
--- FAIL: TestBigQueryIO_BasicWriteRead (4.31s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38985 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LEpkNAHIUI" is_bounded:BOUNDED windowing_strategy_id:"w0@LEpkNAHIUI"}} windowing_strategies:{key:"w0@LEpkNAHIUI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LEpkNAHIUI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LEpkNAHIUI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LEpkNAHIUI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683621070934054466\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LEpkNAHIUI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38985 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LEpkNAHIUI" is_bounded:BOUNDED windowing_strategy_id:"w0@LEpkNAHIUI"}} windowing_strategies:{key:"w0@LEpkNAHIUI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LEpkNAHIUI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LEpkNAHIUI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LEpkNAHIUI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683621070934054466\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LEpkNAHIUI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc000622440})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc000622440})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005d60e0?, 0xc0000c4280?}, {0x11c9c47, 0x39}, {0xc0001340c0?, 0x10c9440?, 0x41bc91?}, {0xc0005af960, 0xf}, 0xc000571d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005d6060?, 0xc0000c4280?}, {0xc000050f00, 0x52}, {0x1?}, {0xc000571ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005af960, 0xf}, {0xc000050f00, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103520, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.342s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.036s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-083038
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-083038
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a9a100c1646e8f5b28d835433fae466d75e5670c335a85e7665be622875fd25
Deleted: sha256:ce3f4329496b72bef02289b1de55d17024b9ab3f62311e4a639d2201f32d16ca
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-083038
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a9a100c1646e8f5b28d835433fae466d75e5670c335a85e7665be622875fd25
Associated tags:
- 20230509-083038
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-083038
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-083038].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a9a100c1646e8f5b28d835433fae466d75e5670c335a85e7665be622875fd25].
$ rm -rf /tmp/tmp.rJzoZXft1c
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509082027
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f0e045351d714beb4cce2883a47fbc082a1d75a94e18e6b687615f05ac8c05
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509082027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f0e045351d714beb4cce2883a47fbc082a1d75a94e18e6b687615f05ac8c05]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509082027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f0e045351d714beb4cce2883a47fbc082a1d75a94e18e6b687615f05ac8c05])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f0e045351d714beb4cce2883a47fbc082a1d75a94e18e6b687615f05ac8c05
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f0e045351d714beb4cce2883a47fbc082a1d75a94e18e6b687615f05ac8c05
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f0e045351d714beb4cce2883a47fbc082a1d75a94e18e6b687615f05ac8c05].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509082027
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a98e14c84638395f7f9bf91130d8d289cd87df7a77458b954b39023bbd1bf2b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509082027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a98e14c84638395f7f9bf91130d8d289cd87df7a77458b954b39023bbd1bf2b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509082027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a98e14c84638395f7f9bf91130d8d289cd87df7a77458b954b39023bbd1bf2b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a98e14c84638395f7f9bf91130d8d289cd87df7a77458b954b39023bbd1bf2b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a98e14c84638395f7f9bf91130d8d289cd87df7a77458b954b39023bbd1bf2b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a98e14c84638395f7f9bf91130d8d289cd87df7a77458b954b39023bbd1bf2b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1596115.
Stopping expansion service pid: 1596116.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 5s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/3bcezktke77cq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1612
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1612/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509022040",
"environmentId": "LVWnIQTZTzbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-023108"
}
]
},
"name": "go-testxlang_partition-997",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/09 03:15:34 Submitted job: 2023-05-08_20_15_34-16962272454492575543
2023/05/09 03:15:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-08_20_15_34-16962272454492575543?project=apache-beam-testing
2023/05/09 03:15:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-08_20_15_34-16962272454492575543
2023/05/09 03:15:34 Job state: JOB_STATE_PENDING ...
2023/05/09 03:16:04 Job still running ...
2023/05/09 03:16:34 Job still running ...
2023/05/09 03:17:04 Job still running ...
2023/05/09 03:17:35 Job still running ...
2023/05/09 03:18:05 Job still running ...
2023/05/09 03:18:35 Job still running ...
2023/05/09 03:19:05 Job still running ...
2023/05/09 03:19:35 Job still running ...
2023/05/09 03:20:05 Job still running ...
2023/05/09 03:20:35 Job still running ...
2023/05/09 03:21:05 Job still running ...
2023/05/09 03:21:35 Job still running ...
2023/05/09 03:22:05 Job still running ...
2023/05/09 03:22:35 Job still running ...
2023/05/09 03:23:05 Job still running ...
2023/05/09 03:23:35 Job still running ...
2023/05/09 03:24:05 Job still running ...
2023/05/09 03:24:35 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-08_20_15_34-16962272454492575543 failed
--- FAIL: TestXLang_Partition (579.94s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3208.209s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683599501832184048
--- FAIL: TestBigQueryIO_BasicWriteRead (5.86s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39095 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@cwdLeLhJcH" is_bounded:BOUNDED windowing_strategy_id:"w0@cwdLeLhJcH"}} windowing_strategies:{key:"w0@cwdLeLhJcH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@cwdLeLhJcH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@cwdLeLhJcH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@cwdLeLhJcH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683599501832184048\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"cwdLeLhJcH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39095 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@cwdLeLhJcH" is_bounded:BOUNDED windowing_strategy_id:"w0@cwdLeLhJcH"}} windowing_strategies:{key:"w0@cwdLeLhJcH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@cwdLeLhJcH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@cwdLeLhJcH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@cwdLeLhJcH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683599501832184048\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"cwdLeLhJcH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 23 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc00066f000})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc00066f000})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000da0a0?, 0xc000136230?}, {0x11c9c47, 0x39}, {0xc000158180?, 0x10c9440?, 0x41bc91?}, {0xc000045f40, 0xf}, 0xc0002e7d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000da020?, 0xc000136230?}, {0xc000050960, 0x52}, {0x1?}, {0xc0002e7ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc000050960, 0x52}, {0xf25d40, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000c7380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000c7380, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.882s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:387e2d3e09e164080447814f51e7a0209ced795fe9dc443a96166d0b3e7f1271
Associated tags:
- 20230509-023108
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-023108
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230509-023108].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:387e2d3e09e164080447814f51e7a0209ced795fe9dc443a96166d0b3e7f1271].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:986f3e91e0c316556fcd4d003508e4058df69f5cde517bf477149faedefbb527]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230509022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:986f3e91e0c316556fcd4d003508e4058df69f5cde517bf477149faedefbb527])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:986f3e91e0c316556fcd4d003508e4058df69f5cde517bf477149faedefbb527
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:986f3e91e0c316556fcd4d003508e4058df69f5cde517bf477149faedefbb527].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1077ba1672bdf7e36348bfa3a799460e20503b429140aaa09d0177fa7dbe9ef]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230509022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1077ba1672bdf7e36348bfa3a799460e20503b429140aaa09d0177fa7dbe9ef])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1077ba1672bdf7e36348bfa3a799460e20503b429140aaa09d0177fa7dbe9ef
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1077ba1672bdf7e36348bfa3a799460e20503b429140aaa09d0177fa7dbe9ef].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 52s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/jrvbkv4hyniic
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1611
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1611/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230508202139",
"environmentId": "RzubJrzKqhbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-203241",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-203241"
}
]
},
"name": "go-testxlang_partition-226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/08 21:18:11 Submitted job: 2023-05-08_14_18_10-13451267209522156190
2023/05/08 21:18:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-08_14_18_10-13451267209522156190?project=apache-beam-testing
2023/05/08 21:18:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-08_14_18_10-13451267209522156190
2023/05/08 21:18:11 Job state: JOB_STATE_PENDING ...
2023/05/08 21:18:41 Job still running ...
2023/05/08 21:19:11 Job still running ...
2023/05/08 21:19:41 Job still running ...
2023/05/08 21:20:11 Job still running ...
2023/05/08 21:20:41 Job still running ...
2023/05/08 21:21:11 Job still running ...
2023/05/08 21:21:41 Job still running ...
2023/05/08 21:22:11 Job still running ...
2023/05/08 21:22:41 Job still running ...
2023/05/08 21:23:11 Job still running ...
2023/05/08 21:23:41 Job still running ...
2023/05/08 21:24:11 Job still running ...
2023/05/08 21:24:41 Job still running ...
2023/05/08 21:25:11 Job still running ...
2023/05/08 21:25:41 Job still running ...
2023/05/08 21:26:12 Job still running ...
2023/05/08 21:26:42 Job still running ...
2023/05/08 21:27:12 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-08_14_18_10-13451267209522156190 failed
--- FAIL: TestXLang_Partition (580.66s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3271.394s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683577998551440282
--- FAIL: TestBigQueryIO_BasicWriteRead (6.01s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42399 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XSOEPGIOaA" is_bounded:BOUNDED windowing_strategy_id:"w0@XSOEPGIOaA"}} windowing_strategies:{key:"w0@XSOEPGIOaA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XSOEPGIOaA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XSOEPGIOaA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XSOEPGIOaA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683577998551440282\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XSOEPGIOaA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42399 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XSOEPGIOaA" is_bounded:BOUNDED windowing_strategy_id:"w0@XSOEPGIOaA"}} windowing_strategies:{key:"w0@XSOEPGIOaA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XSOEPGIOaA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XSOEPGIOaA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XSOEPGIOaA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683577998551440282\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XSOEPGIOaA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0005f8700})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0005f8700})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1e0?, 0xc000596000?}, {0x11c9c47, 0x39}, {0xc0000f6180?, 0x10c9440?, 0x41bc91?}, {0xc00046bc70, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc000596000?}, {0xc00061e840, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046bc70, 0xf}, {0xc00061e840, 0x52}, {0xf25d40, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2b60, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.041s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:543307315848ce6ae6a62c397f1e0932001381e9a311b6aedbaef5f762cfc05c
Associated tags:
- 20230508-203241
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-203241
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-203241].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:543307315848ce6ae6a62c397f1e0932001381e9a311b6aedbaef5f762cfc05c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230508202139]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5442012e4d86096630b5f89f62cdb4ca00638fbf88b28138875728f6e94f07b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230508202139] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5442012e4d86096630b5f89f62cdb4ca00638fbf88b28138875728f6e94f07b])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5442012e4d86096630b5f89f62cdb4ca00638fbf88b28138875728f6e94f07b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5442012e4d86096630b5f89f62cdb4ca00638fbf88b28138875728f6e94f07b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230508202139]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:76aa40e3338e9b53bc245cc5fb1b379fbd231a83c3be67be4d63a4f71f8f3e7e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230508202139] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:76aa40e3338e9b53bc245cc5fb1b379fbd231a83c3be67be4d63a4f71f8f3e7e])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:76aa40e3338e9b53bc245cc5fb1b379fbd231a83c3be67be4d63a4f71f8f3e7e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:76aa40e3338e9b53bc245cc5fb1b379fbd231a83c3be67be4d63a4f71f8f3e7e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 29s
232 actionable tasks: 168 executed, 54 from cache, 10 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/tmtaveu6nwrua
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1610
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1610/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-182940",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-182940"
}
]
},
"name": "go-testxlang_partition-823",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/08 19:13:14 Submitted job: 2023-05-08_12_13_13-15885753748119222321
2023/05/08 19:13:14 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-08_12_13_13-15885753748119222321?project=apache-beam-testing
2023/05/08 19:13:14 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-08_12_13_13-15885753748119222321
2023/05/08 19:13:14 Job state: JOB_STATE_PENDING ...
2023/05/08 19:13:44 Job still running ...
2023/05/08 19:14:14 Job still running ...
2023/05/08 19:14:44 Job still running ...
2023/05/08 19:15:14 Job still running ...
2023/05/08 19:15:44 Job still running ...
2023/05/08 19:16:14 Job still running ...
2023/05/08 19:16:44 Job still running ...
2023/05/08 19:17:14 Job still running ...
2023/05/08 19:17:44 Job still running ...
2023/05/08 19:18:14 Job still running ...
2023/05/08 19:18:44 Job still running ...
2023/05/08 19:19:14 Job still running ...
2023/05/08 19:19:44 Job still running ...
2023/05/08 19:20:14 Job still running ...
2023/05/08 19:20:44 Job still running ...
2023/05/08 19:21:14 Job still running ...
2023/05/08 19:21:44 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-08_12_13_13-15885753748119222321 failed
--- FAIL: TestXLang_Partition (550.72s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3121.685s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683570621780204470
--- FAIL: TestBigQueryIO_BasicWriteRead (5.32s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35735 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xRWRivaFFm" is_bounded:BOUNDED windowing_strategy_id:"w0@xRWRivaFFm"}} windowing_strategies:{key:"w0@xRWRivaFFm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xRWRivaFFm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xRWRivaFFm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xRWRivaFFm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683570621780204470\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xRWRivaFFm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35735 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xRWRivaFFm" is_bounded:BOUNDED windowing_strategy_id:"w0@xRWRivaFFm"}} windowing_strategies:{key:"w0@xRWRivaFFm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xRWRivaFFm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xRWRivaFFm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xRWRivaFFm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683570621780204470\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xRWRivaFFm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:402)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:555)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:639)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe15c0, 0xc0006566c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe15c0, 0xc0006566c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005400c0?, 0xc000522050?}, {0x11c9c47, 0x39}, {0xc000158180?, 0x10c9440?, 0x41bc91?}, {0xc000489f70, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000540040?, 0xc000522050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee1120?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f70, 0xf}, {0xc00010ec00, 0x52}, {0xf25d40, 0xc0006a6018})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11fd0b8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.348s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-182940
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-182940
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1d9abd0ea8e9fe26e7321e921f86c33cc6e2551a0a2ac25d889d9389ee56f25a
Deleted: sha256:df33415469a566d8b8a0edc182a9e64c5ae3931f8a768497dd364be78c3b9ee8
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-182940
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1d9abd0ea8e9fe26e7321e921f86c33cc6e2551a0a2ac25d889d9389ee56f25a
Associated tags:
- 20230508-182940
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-182940
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230508-182940].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1d9abd0ea8e9fe26e7321e921f86c33cc6e2551a0a2ac25d889d9389ee56f25a].
$ rm -rf /tmp/tmp.WJ9YyUb5RB
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230508181722
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a96b1237cd1057398ed82088895c7aa38319761ba89ebcd1cac6aaea782f97e9
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230508181722]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a96b1237cd1057398ed82088895c7aa38319761ba89ebcd1cac6aaea782f97e9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230508181722] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a96b1237cd1057398ed82088895c7aa38319761ba89ebcd1cac6aaea782f97e9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a96b1237cd1057398ed82088895c7aa38319761ba89ebcd1cac6aaea782f97e9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a96b1237cd1057398ed82088895c7aa38319761ba89ebcd1cac6aaea782f97e9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a96b1237cd1057398ed82088895c7aa38319761ba89ebcd1cac6aaea782f97e9].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230508181722
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17e6253ff65a4b0f6ee39089f76737a2b131ed347b337735f2c9a157109b7d6b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230508181722]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17e6253ff65a4b0f6ee39089f76737a2b131ed347b337735f2c9a157109b7d6b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230508181722] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17e6253ff65a4b0f6ee39089f76737a2b131ed347b337735f2c9a157109b7d6b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17e6253ff65a4b0f6ee39089f76737a2b131ed347b337735f2c9a157109b7d6b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17e6253ff65a4b0f6ee39089f76737a2b131ed347b337735f2c9a157109b7d6b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:17e6253ff65a4b0f6ee39089f76737a2b131ed347b337735f2c9a157109b7d6b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1868312.
Stopping expansion service pid: 1868313.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 25s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/cv5hnn22zhr4a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_XVR_GoUsingJava_Dataflow - Build # 1609 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_GoUsingJava_Dataflow - Build # 1609 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1609/ to view the results.
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1608
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1608/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/bigquery from 1.51.0 to 1.51.1 in /sdks
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-143127",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-143127"
}
]
},
"name": "go-testxlang_partition-885",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/05 15:16:29 Submitted job: 2023-05-05_08_16_29-12863551104588798914
2023/05/05 15:16:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-05_08_16_29-12863551104588798914?project=apache-beam-testing
2023/05/05 15:16:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-05_08_16_29-12863551104588798914
2023/05/05 15:16:29 Job state: JOB_STATE_PENDING ...
2023/05/05 15:16:59 Job still running ...
2023/05/05 15:17:29 Job still running ...
2023/05/05 15:17:59 Job still running ...
2023/05/05 15:18:30 Job still running ...
2023/05/05 15:19:00 Job still running ...
2023/05/05 15:19:30 Job still running ...
2023/05/05 15:20:00 Job still running ...
2023/05/05 15:20:30 Job still running ...
2023/05/05 15:21:00 Job still running ...
2023/05/05 15:21:30 Job still running ...
2023/05/05 15:22:00 Job still running ...
2023/05/05 15:22:30 Job still running ...
2023/05/05 15:23:00 Job still running ...
2023/05/05 15:23:30 Job still running ...
2023/05/05 15:24:00 Job still running ...
2023/05/05 15:24:30 Job still running ...
2023/05/05 15:25:00 Job still running ...
2023/05/05 15:25:30 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-05_08_16_29-12863551104588798914 failed
--- FAIL: TestXLang_Partition (580.30s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3242.402s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683297121604449853
--- FAIL: TestBigQueryIO_BasicWriteRead (4.66s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41937 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KIfMzMBPKv" is_bounded:BOUNDED windowing_strategy_id:"w0@KIfMzMBPKv"}} windowing_strategies:{key:"w0@KIfMzMBPKv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KIfMzMBPKv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KIfMzMBPKv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KIfMzMBPKv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683297121604449853\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KIfMzMBPKv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41937 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KIfMzMBPKv" is_bounded:BOUNDED windowing_strategy_id:"w0@KIfMzMBPKv"}} windowing_strategies:{key:"w0@KIfMzMBPKv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KIfMzMBPKv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KIfMzMBPKv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KIfMzMBPKv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683297121604449853\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KIfMzMBPKv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0004d7bc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0004d7bc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006140c0?, 0xc000524000?}, {0x11c8c7d, 0x39}, {0xc00052c0c0?, 0x10c85c0?, 0x41bc91?}, {0xc00046dbb0, 0xf}, 0xc000219d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000614040?, 0xc000524000?}, {0xc000050d20, 0x52}, {0x1?}, {0xc000219ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dbb0, 0xf}, {0xc000050d20, 0x52}, {0xf24d60, 0xc0001262b8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d9520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d9520, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.687s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-143127
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-143127
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a153bef39eefd54d95a03495023aa158d8fb15a6bcfdacff3f11fddf34c1db3
Deleted: sha256:da6c2313534b2953c8c304f3aeb95da53be64b308e35df1fc807f732ca11413f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-143127
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a153bef39eefd54d95a03495023aa158d8fb15a6bcfdacff3f11fddf34c1db3
Associated tags:
- 20230505-143127
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-143127
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-143127].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a153bef39eefd54d95a03495023aa158d8fb15a6bcfdacff3f11fddf34c1db3].
$ rm -rf /tmp/tmp.aMqNZq35bE
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505142052
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:83e5dcd01919d87ad33ee6e84beb76a4428d6cb04cea06799d82c4fea84884a5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505142052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:83e5dcd01919d87ad33ee6e84beb76a4428d6cb04cea06799d82c4fea84884a5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505142052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:83e5dcd01919d87ad33ee6e84beb76a4428d6cb04cea06799d82c4fea84884a5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:83e5dcd01919d87ad33ee6e84beb76a4428d6cb04cea06799d82c4fea84884a5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:83e5dcd01919d87ad33ee6e84beb76a4428d6cb04cea06799d82c4fea84884a5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:83e5dcd01919d87ad33ee6e84beb76a4428d6cb04cea06799d82c4fea84884a5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505142052
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ceb9d4be4613581eb0fbc0e8d20e146ab8344cd4c3e8d146282a5caf1a7693db
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505142052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ceb9d4be4613581eb0fbc0e8d20e146ab8344cd4c3e8d146282a5caf1a7693db]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505142052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ceb9d4be4613581eb0fbc0e8d20e146ab8344cd4c3e8d146282a5caf1a7693db])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ceb9d4be4613581eb0fbc0e8d20e146ab8344cd4c3e8d146282a5caf1a7693db
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ceb9d4be4613581eb0fbc0e8d20e146ab8344cd4c3e8d146282a5caf1a7693db
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ceb9d4be4613581eb0fbc0e8d20e146ab8344cd4c3e8d146282a5caf1a7693db].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1603061.
Stopping expansion service pid: 1603062.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 34s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/sjisrdddrswls
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1607
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1607/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505082040",
"environmentId": "jfNpuZjKnebeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-083109"
}
]
},
"name": "go-testxlang_partition-587",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/05 09:16:09 Submitted job: 2023-05-05_02_16_08-11845335731150014478
2023/05/05 09:16:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-05_02_16_08-11845335731150014478?project=apache-beam-testing
2023/05/05 09:16:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-05_02_16_08-11845335731150014478
2023/05/05 09:16:09 Job state: JOB_STATE_PENDING ...
2023/05/05 09:16:39 Job still running ...
2023/05/05 09:17:09 Job still running ...
2023/05/05 09:17:39 Job still running ...
2023/05/05 09:18:09 Job still running ...
2023/05/05 09:18:39 Job still running ...
2023/05/05 09:19:09 Job still running ...
2023/05/05 09:19:39 Job still running ...
2023/05/05 09:20:09 Job still running ...
2023/05/05 09:20:39 Job still running ...
2023/05/05 09:21:09 Job still running ...
2023/05/05 09:21:39 Job still running ...
2023/05/05 09:22:09 Job still running ...
2023/05/05 09:22:39 Job still running ...
2023/05/05 09:23:09 Job still running ...
2023/05/05 09:23:39 Job still running ...
2023/05/05 09:24:09 Job still running ...
2023/05/05 09:24:39 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-05_02_16_08-11845335731150014478 failed
--- FAIL: TestXLang_Partition (551.00s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3211.388s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683275501841015054
--- FAIL: TestBigQueryIO_BasicWriteRead (4.37s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40333 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qiwIJeITCy" is_bounded:BOUNDED windowing_strategy_id:"w0@qiwIJeITCy"}} windowing_strategies:{key:"w0@qiwIJeITCy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qiwIJeITCy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qiwIJeITCy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qiwIJeITCy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683275501841015054\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qiwIJeITCy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40333 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qiwIJeITCy" is_bounded:BOUNDED windowing_strategy_id:"w0@qiwIJeITCy"}} windowing_strategies:{key:"w0@qiwIJeITCy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qiwIJeITCy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qiwIJeITCy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qiwIJeITCy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683275501841015054\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qiwIJeITCy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 39 [running]:
testing.tRunner.func1.2({0xfe1640, 0xc00033a400})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1640, 0xc00033a400})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000500ec0?, 0xc0005582d0?}, {0x11c9c7d, 0x39}, {0xc0000f6180?, 0x10c95c0?, 0x1?}, {0xc00046bbf0, 0xf}, 0xc00017bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000500e40?, 0xc0005582d0?}, {0xc000050d20, 0x52}, {0x1?}, {0xc00017bea8, 0x2, 0xee1140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046bbf0, 0xf}, {0xc000050d20, 0x52}, {0xf25d60, 0xc000535000})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d96c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d96c0, 0x11fd298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.396s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2fb445657000e17a821c54460d9e283dbd183f21b25d7e2d19d47b85be0a530a
Associated tags:
- 20230505-083109
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-083109
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-083109].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2fb445657000e17a821c54460d9e283dbd183f21b25d7e2d19d47b85be0a530a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8361db57eafd9e4a5b864126f3820d6dc294539b3190532eb457681295890a99]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8361db57eafd9e4a5b864126f3820d6dc294539b3190532eb457681295890a99])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8361db57eafd9e4a5b864126f3820d6dc294539b3190532eb457681295890a99
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8361db57eafd9e4a5b864126f3820d6dc294539b3190532eb457681295890a99].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:756b997bb8cb3457351739dbcc147c609982aeb352c390b7bfc041a56696d908]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:756b997bb8cb3457351739dbcc147c609982aeb352c390b7bfc041a56696d908])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:756b997bb8cb3457351739dbcc147c609982aeb352c390b7bfc041a56696d908
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:756b997bb8cb3457351739dbcc147c609982aeb352c390b7bfc041a56696d908].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 56s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/iatnsemiqjiei
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1606
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1606/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505022039",
"environmentId": "nbVXibprBsbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-023204"
}
]
},
"name": "go-testxlang_partition-103",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/05 03:16:40 Submitted job: 2023-05-04_20_16_40-42199212815042359
2023/05/05 03:16:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-04_20_16_40-42199212815042359?project=apache-beam-testing
2023/05/05 03:16:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-04_20_16_40-42199212815042359
2023/05/05 03:16:40 Job state: JOB_STATE_PENDING ...
2023/05/05 03:17:10 Job still running ...
2023/05/05 03:17:40 Job still running ...
2023/05/05 03:18:10 Job still running ...
2023/05/05 03:18:41 Job still running ...
2023/05/05 03:19:11 Job still running ...
2023/05/05 03:19:41 Job still running ...
2023/05/05 03:20:11 Job still running ...
2023/05/05 03:20:41 Job still running ...
2023/05/05 03:21:11 Job still running ...
2023/05/05 03:21:41 Job still running ...
2023/05/05 03:22:11 Job still running ...
2023/05/05 03:22:41 Job still running ...
2023/05/05 03:23:11 Job still running ...
2023/05/05 03:23:41 Job still running ...
2023/05/05 03:24:11 Job still running ...
2023/05/05 03:24:41 Job still running ...
2023/05/05 03:25:11 Job still running ...
2023/05/05 03:25:41 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-04_20_16_40-42199212815042359 failed
--- FAIL: TestXLang_Partition (582.06s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3212.123s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683253966833792514
--- FAIL: TestBigQueryIO_BasicWriteRead (5.41s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36409 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jaTYURTkTP" is_bounded:BOUNDED windowing_strategy_id:"w0@jaTYURTkTP"}} windowing_strategies:{key:"w0@jaTYURTkTP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jaTYURTkTP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jaTYURTkTP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jaTYURTkTP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683253966833792514\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jaTYURTkTP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36409 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jaTYURTkTP" is_bounded:BOUNDED windowing_strategy_id:"w0@jaTYURTkTP"}} windowing_strategies:{key:"w0@jaTYURTkTP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jaTYURTkTP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jaTYURTkTP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jaTYURTkTP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683253966833792514\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jaTYURTkTP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 22 [running]:
testing.tRunner.func1.2({0xfe1640, 0xc0003ee7c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1640, 0xc0003ee7c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00051e0a0?, 0xc000136230?}, {0x11c9c7d, 0x39}, {0xc000158180?, 0x10c95c0?, 0x41bc91?}, {0xc000045f40, 0xf}, 0xc0002d7d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00051e020?, 0xc000136230?}, {0xc000050960, 0x52}, {0x1?}, {0xc0002d7ea8, 0x2, 0xee1140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc000050960, 0x52}, {0xf25d60, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000501a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000501a00, 0x11fd298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.439s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-023204
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-023204
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4bb6475918d0aadaee9dae1a94b75b739f32bf15b185779d0df5c68d7874e2f8
Deleted: sha256:dd4de93cdeafdd01bb0f0cba9e0c69592c834a7cf756cc8244a84e09c43f5da1
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-023204
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4bb6475918d0aadaee9dae1a94b75b739f32bf15b185779d0df5c68d7874e2f8
Associated tags:
- 20230505-023204
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-023204
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230505-023204].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4bb6475918d0aadaee9dae1a94b75b739f32bf15b185779d0df5c68d7874e2f8].
$ rm -rf /tmp/tmp.bxBP5JFEee
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505022039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d2b65f8063166686e7c2ce6e2f20bf29314d93b88614f344ede0046af68283b9
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d2b65f8063166686e7c2ce6e2f20bf29314d93b88614f344ede0046af68283b9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230505022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d2b65f8063166686e7c2ce6e2f20bf29314d93b88614f344ede0046af68283b9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d2b65f8063166686e7c2ce6e2f20bf29314d93b88614f344ede0046af68283b9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d2b65f8063166686e7c2ce6e2f20bf29314d93b88614f344ede0046af68283b9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d2b65f8063166686e7c2ce6e2f20bf29314d93b88614f344ede0046af68283b9].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505022039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6f6bb5d209fb5e3186ce45aec83bb38987732b9cc4b6bf872c94ff299dff7a9
Deleted: sha256:3dd36fbdc06a7be6e3dcb490ef5b5b7fd9745bc9d85135d040b501d3304f9abf
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6f6bb5d209fb5e3186ce45aec83bb38987732b9cc4b6bf872c94ff299dff7a9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230505022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6f6bb5d209fb5e3186ce45aec83bb38987732b9cc4b6bf872c94ff299dff7a9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6f6bb5d209fb5e3186ce45aec83bb38987732b9cc4b6bf872c94ff299dff7a9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6f6bb5d209fb5e3186ce45aec83bb38987732b9cc4b6bf872c94ff299dff7a9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6f6bb5d209fb5e3186ce45aec83bb38987732b9cc4b6bf872c94ff299dff7a9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1209336.
Stopping expansion service pid: 1209337.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 59s
232 actionable tasks: 168 executed, 54 from cache, 10 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/bru5mlbs25spe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1605
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1605/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230504202040",
"environmentId": "aNQYCZFhmEbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-203156"
}
]
},
"name": "go-testxlang_partition-67",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/04 21:17:25 Submitted job: 2023-05-04_14_17_25-2437840718729253352
2023/05/04 21:17:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-04_14_17_25-2437840718729253352?project=apache-beam-testing
2023/05/04 21:17:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-04_14_17_25-2437840718729253352
2023/05/04 21:17:25 Job state: JOB_STATE_PENDING ...
2023/05/04 21:17:55 Job still running ...
2023/05/04 21:18:25 Job still running ...
2023/05/04 21:18:55 Job still running ...
2023/05/04 21:19:25 Job still running ...
2023/05/04 21:19:55 Job still running ...
2023/05/04 21:20:25 Job still running ...
2023/05/04 21:20:55 Job still running ...
2023/05/04 21:21:26 Job still running ...
2023/05/04 21:21:56 Job still running ...
2023/05/04 21:22:26 Job still running ...
2023/05/04 21:22:56 Job still running ...
2023/05/04 21:23:26 Job still running ...
2023/05/04 21:23:56 Job still running ...
2023/05/04 21:24:26 Job still running ...
2023/05/04 21:24:56 Job still running ...
2023/05/04 21:25:26 Job still running ...
2023/05/04 21:25:56 Job still running ...
2023/05/04 21:26:26 Job still running ...
2023/05/04 21:26:56 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-04_14_17_25-2437840718729253352 failed
--- FAIL: TestXLang_Partition (610.21s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3299.712s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683232354869944706
--- FAIL: TestBigQueryIO_BasicWriteRead (5.51s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38123 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FquwMPjVDU" is_bounded:BOUNDED windowing_strategy_id:"w0@FquwMPjVDU"}} windowing_strategies:{key:"w0@FquwMPjVDU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FquwMPjVDU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FquwMPjVDU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FquwMPjVDU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683232354869944706\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FquwMPjVDU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38123 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FquwMPjVDU" is_bounded:BOUNDED windowing_strategy_id:"w0@FquwMPjVDU"}} windowing_strategies:{key:"w0@FquwMPjVDU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FquwMPjVDU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FquwMPjVDU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FquwMPjVDU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683232354869944706\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FquwMPjVDU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe1640, 0xc00027c680})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe1640, 0xc00027c680})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006460e0?, 0xc0000c4280?}, {0x11c9c7d, 0x39}, {0xc0006e00c0?, 0x10c95c0?, 0x41bc91?}, {0xc00046be10, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000646060?, 0xc0000c4280?}, {0xc000050f00, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xee1140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046be10, 0xf}, {0xc000050f00, 0x52}, {0xf25d60, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2d00, 0x11fd298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.535s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.042s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:427ca6f6ced6069ed5dcdd6c2aa7ecb1eda14792bec998eef35bc6a8059589b6
Associated tags:
- 20230504-203156
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-203156
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-203156].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:427ca6f6ced6069ed5dcdd6c2aa7ecb1eda14792bec998eef35bc6a8059589b6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230504202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4941cc14e07cfcd0cf845a06bfc5039c52248e2ed4a7ac304df527f8cb4c27c9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230504202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4941cc14e07cfcd0cf845a06bfc5039c52248e2ed4a7ac304df527f8cb4c27c9])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4941cc14e07cfcd0cf845a06bfc5039c52248e2ed4a7ac304df527f8cb4c27c9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4941cc14e07cfcd0cf845a06bfc5039c52248e2ed4a7ac304df527f8cb4c27c9].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230504202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:27d3ce4da0490bc5dbab723ef7006128c2b74d52e3c7d4b921c3579d66a90a2f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230504202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:27d3ce4da0490bc5dbab723ef7006128c2b74d52e3c7d4b921c3579d66a90a2f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:27d3ce4da0490bc5dbab723ef7006128c2b74d52e3c7d4b921c3579d66a90a2f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:27d3ce4da0490bc5dbab723ef7006128c2b74d52e3c7d4b921c3579d66a90a2f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 14s
232 actionable tasks: 165 executed, 57 from cache, 10 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/ygvlp5tiasvew
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1604
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1604/display/redirect?page=changes>
Changes:
[noreply] Updating libraries bom version (#26525)
------------------------------------------
[...truncated 172.21 KB...]
#8 36.01 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 KB 28.3 MB/s eta 0:00:00
#8 36.09 Collecting python-snappy==0.6.1
#8 36.11 Downloading python_snappy-0.6.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (56 kB)
#8 36.11 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.1/56.1 KB 8.8 MB/s eta 0:00:00
#8 36.25 Collecting pytz==2023.3
#8 36.27 Downloading pytz-2023.3-py2.py3-none-any.whl (502 kB)
#8 36.29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 502.3/502.3 KB 35.8 MB/s eta 0:00:00
#8 36.41 Collecting PyYAML==6.0
#8 36.43 Downloading PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (701 kB)
#8 36.45 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 701.2/701.2 KB 36.1 MB/s eta 0:00:00
> Task :sdks:java:io:debezium:expansion-service:shadowJar
> Task :sdks:python:container:py38:docker
#8 37.64 Collecting regex==2023.3.23
#8 37.67 Downloading regex-2023.3.23-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (771 kB)
#8 37.69 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 771.9/771.9 KB 44.5 MB/s eta 0:00:00
#8 37.78 Collecting requests==2.28.2
#8 37.80 Downloading requests-2.28.2-py3-none-any.whl (62 kB)
#8 37.81 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 KB 7.9 MB/s eta 0:00:00
#8 37.85 Collecting requests-mock==1.10.0
#8 37.87 Downloading requests_mock-1.10.0-py2.py3-none-any.whl (28 kB)
#8 37.91 Collecting requests-oauthlib==1.3.1
#8 37.93 Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
#8 38.09 Collecting rsa==4.9
#8 38.11 Downloading rsa-4.9-py3-none-any.whl (34 kB)
#8 38.38 Collecting scikit-learn==1.2.2
#8 38.40 Downloading scikit_learn-1.2.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (9.8 MB)
#8 38.53 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.8/9.8 MB 81.9 MB/s eta 0:00:00
#8 38.93 Collecting scipy==1.10.1
#8 38.95 Downloading scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
> Task :sdks:java:io:debezium:expansion-service:startShadowScripts
> Task :sdks:java:io:debezium:expansion-service:shadowDistTar
> Task :sdks:python:container:py38:docker
#8 39.45 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.5/34.5 MB 33.5 MB/s eta 0:00:00
#8 39.63 Collecting six==1.16.0
#8 39.65 Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
#8 39.70 Collecting sortedcontainers==2.4.0
#8 39.72 Downloading sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
#8 39.78 Collecting soupsieve==2.4
#8 39.80 Downloading soupsieve-2.4-py3-none-any.whl (37 kB)
#8 40.68 Collecting SQLAlchemy==1.4.47
#8 40.70 Downloading SQLAlchemy-1.4.47-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
#8 40.74 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 45.2 MB/s eta 0:00:00
#8 40.81 Collecting sqlparse==0.4.3
#8 40.83 Downloading sqlparse-0.4.3-py3-none-any.whl (42 kB)
#8 40.84 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.8/42.8 KB 5.4 MB/s eta 0:00:00
#8 40.90 Collecting tenacity==8.2.2
#8 40.91 Downloading tenacity-8.2.2-py3-none-any.whl (24 kB)
#8 40.98 Collecting tensorboard==2.12.1
#8 41.00 Downloading tensorboard-2.12.1-py3-none-any.whl (5.6 MB)
#8 41.08 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.6/5.6 MB 79.9 MB/s eta 0:00:00
#8 41.15 Collecting tensorboard-data-server==0.7.0
#8 41.17 Downloading tensorboard_data_server-0.7.0-py3-none-manylinux2014_x86_64.whl (6.6 MB)
#8 41.25 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.6/6.6 MB 84.2 MB/s eta 0:00:00
#8 41.31 Collecting tensorboard-plugin-wit==1.8.1
#8 41.33 Downloading tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
#8 41.35 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 781.3/781.3 KB 47.0 MB/s eta 0:00:00
#8 41.67 Collecting tensorflow==2.12.0
#8 41.69 Downloading tensorflow-2.12.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
> Task :sdks:java:io:debezium:expansion-service:shadowDistZip
> Task :sdks:java:io:debezium:expansion-service:assemble
> Task :sdks:java:io:debezium:expansion-service:analyzeClassesDependencies
> Task :sdks:java:io:debezium:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:debezium:expansion-service:analyzeDependencies
> Task :sdks:java:io:debezium:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:debezium:expansion-service:test NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:check
> Task :sdks:java:io:debezium:expansion-service:build
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowJar
> Task :sdks:python:container:py38:docker
#8 53.93 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 585.9/585.9 MB 1.3 MB/s eta 0:00:00
#8 56.26 Collecting tensorflow-estimator==2.12.0
#8 56.28 Downloading tensorflow_estimator-2.12.0-py2.py3-none-any.whl (440 kB)
#8 56.29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 440.7/440.7 KB 39.0 MB/s eta 0:00:00
#8 56.39 Collecting tensorflow-io-gcs-filesystem==0.32.0
#8 56.41 Downloading tensorflow_io_gcs_filesystem-0.32.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
#8 56.44 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 73.7 MB/s eta 0:00:00
#8 56.49 Collecting termcolor==2.2.0
#8 56.51 Downloading termcolor-2.2.0-py3-none-any.whl (6.6 kB)
#8 56.56 Collecting testcontainers==3.7.1
#8 56.58 Downloading testcontainers-3.7.1-py2.py3-none-any.whl (45 kB)
#8 56.59 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.3/45.3 KB 6.4 MB/s eta 0:00:00
#8 56.62 Collecting threadpoolctl==3.1.0
#8 56.64 Downloading threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
#8 56.69 Collecting tomli==2.0.1
#8 56.71 Downloading tomli-2.0.1-py3-none-any.whl (12 kB)
#8 56.85 Collecting tqdm==4.65.0
#8 56.87 Downloading tqdm-4.65.0-py3-none-any.whl (77 kB)
#8 56.88 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.1/77.1 KB 11.4 MB/s eta 0:00:00
#8 56.92 Collecting typing_extensions==4.5.0
#8 56.95 Downloading typing_extensions-4.5.0-py3-none-any.whl (27 kB)
#8 57.05 Collecting urllib3==1.26.15
#8 57.07 Downloading urllib3-1.26.15-py2.py3-none-any.whl (140 kB)
#8 57.08 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.9/140.9 KB 19.2 MB/s eta 0:00:00
#8 57.14 Collecting websocket-client==1.5.1
#8 57.15 Downloading websocket_client-1.5.1-py3-none-any.whl (55 kB)
#8 57.16 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.9/55.9 KB 8.0 MB/s eta 0:00:00
#8 57.24 Collecting Werkzeug==2.2.3
#8 57.26 Downloading Werkzeug-2.2.3-py3-none-any.whl (233 kB)
#8 57.27 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 233.6/233.6 KB 28.0 MB/s eta 0:00:00
#8 57.52 Collecting wrapt==1.14.1
#8 57.54 Downloading wrapt-1.14.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB)
#8 57.55 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81.0/81.0 KB 10.7 MB/s eta 0:00:00
#8 57.61 Collecting zipp==3.15.0
#8 57.63 Downloading zipp-3.15.0-py3-none-any.whl (6.8 kB)
> Task :sdks:java:io:google-cloud-platform:expansion-service:startShadowScripts
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistTar
> Task :sdks:python:container:py38:docker
#8 57.90 Collecting zstandard==0.20.0
#8 57.92 Downloading zstandard-0.20.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.6 MB)
#8 57.97 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 64.7 MB/s eta 0:00:00
#8 59.80 Building wheels for collected packages: bs4, crcmod, dill, docopt, future, google-apitools, jax
#8 59.80 Building wheel for bs4 (setup.py): started
#8 60.27 Building wheel for bs4 (setup.py): finished with status 'done'
#8 60.27 Created wheel for bs4: filename=bs4-0.0.1-py3-none-any.whl size=1272 sha256=b37d4417cafe0a54f015c9884a57fe373ad7ef0ec40d736b3687dba82aa4fb70
#8 60.27 Stored in directory: /root/.cache/pip/wheels/75/78/21/68b124549c9bdc94f822c02fb9aa3578a669843f9767776bca
#8 60.28 Building wheel for crcmod (setup.py): started
#8 61.07 Building wheel for crcmod (setup.py): finished with status 'done'
#8 61.07 Created wheel for crcmod: filename=crcmod-1.7-cp38-cp38-linux_x86_64.whl size=30649 sha256=db8761d248521a508c218d1fbb42e70af7080f8c3704c64f67f6c33ee4b21533
#8 61.07 Stored in directory: /root/.cache/pip/wheels/ca/5a/02/f3acf982a026f3319fb3e798a8dca2d48fafee7761788562e9
#8 61.08 Building wheel for dill (setup.py): started
#8 61.62 Building wheel for dill (setup.py): finished with status 'done'
#8 61.62 Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78545 sha256=357c334bf95dc7a24825bd65df36bc28a9be9048dd3ff4ba695dc5a53d922ce7
#8 61.63 Stored in directory: /root/.cache/pip/wheels/07/35/78/e9004fa30578734db7f10e7a211605f3f0778d2bdde38a239d
#8 61.63 Building wheel for docopt (setup.py): started
#8 62.03 Building wheel for docopt (setup.py): finished with status 'done'
#8 62.03 Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13723 sha256=b97237283c2ac6e09cc4766b7e0eacce4af56cf00ddc826ec5497aa95f88c034
#8 62.03 Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c
#8 62.04 Building wheel for future (setup.py): started
#8 62.74 Building wheel for future (setup.py): finished with status 'done'
#8 62.75 Created wheel for future: filename=future-0.18.3-py3-none-any.whl size=492035 sha256=88af8c545c17446d2adf5cb7fba856395065d5bf81682d1ab5a3edbfa6d833e0
#8 62.75 Stored in directory: /root/.cache/pip/wheels/a0/0b/ee/e6994fadb42c1354dcccb139b0bf2795271bddfe6253ccdf11
#8 62.75 Building wheel for google-apitools (setup.py): started
#8 63.22 Building wheel for google-apitools (setup.py): finished with status 'done'
#8 63.22 Created wheel for google-apitools: filename=google_apitools-0.5.31-py3-none-any.whl size=131040 sha256=5b6c2bf230803281c7ee310a913e402c5f511a3eb909e2f31de11d399158d60e
#8 63.22 Stored in directory: /root/.cache/pip/wheels/d7/54/79/85de1824f2f4175fb4960c72afb10045d86700c3941dc73685
#8 63.23 Building wheel for jax (pyproject.toml): started
#8 64.14 Building wheel for jax (pyproject.toml): finished with status 'done'
#8 64.15 Created wheel for jax: filename=jax-0.4.8-py3-none-any.whl size=1439678 sha256=b8031315ee9c3f5aa150eede42c419805d54086bfda6158ea79b8e64d85ac230
#8 64.15 Stored in directory: /root/.cache/pip/wheels/45/83/1e/3db22c5e1941c10e41c4f5cdf829b0a358146d4d0733d4a105
#8 64.16 Successfully built bs4 crcmod dill docopt future google-apitools jax
#8 64.16 Installing collected packages: tensorboard-plugin-wit, sortedcontainers, requests-mock, pytz, python-snappy, pyasn1-modules, pyasn1, parameterized, oauth2client, nose, mmh3, libclang, hdfs, google-pasta, google-auth-httplib2, flatbuffers, docopt, deprecation, crcmod, cffi, bs4, astunparse, zstandard, zipp, wrapt, Werkzeug, websocket-client, urllib3, typing_extensions, tqdm, tomli, threadpoolctl, testcontainers, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorflow, tensorboard-data-server, tensorboard, tenacity, sqlparse, SQLAlchemy, soupsieve, six, scipy, scikit-learn, rsa, requests-oauthlib, requests, regex, PyYAML, python-dateutil, pytest-xdist, pytest-timeout, pytest, pyparsing, PyMySQL, pymongo, PyHamcrest, pydot, pycparser, pyarrow, psycopg2-binary, protobuf, proto-plus, pluggy, pandas, packaging, overrides, orjson, opt-einsum, objsize, oauthlib, numpy, nltk, mock, ml-dtypes, MarkupSafe, Markdown, keras, joblib, jax, iniconfig, importlib-metadata, idna, hypothesis, httplib2, h5py, guppy3, grpcio-status, grpcio, grpc-google-iam-v1, greenlet, googleapis-common-protos, google-resumable-media, google-crc32c, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-auth-oauthlib, google-auth, google-apitools, google-api-core, gast, future, freezegun, fasteners, fastavro, execnet, exceptiongroup, docker, dnspython, dill, Cython, cryptography, cloudpickle, click, charset-normalizer, certifi, cachetools, beautifulsoup4, attrs, absl-py
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistZip
> Task :sdks:java:io:google-cloud-platform:expansion-service:assemble
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotlessJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotlessJavaCheck UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotlessCheck UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:check
> Task :sdks:java:io:google-cloud-platform:expansion-service:build
> Task :runners:google-cloud-dataflow-java:worker:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:google-cloud-dataflow-java:worker:classes
> Task :runners:google-cloud-dataflow-java:worker:shadowJar
> Task :sdks:python:container:py38:docker
#8 124.0 Successfully installed Cython-0.29.34 Markdown-3.4.3 MarkupSafe-2.1.2 PyHamcrest-1.10.1 PyMySQL-1.0.3 PyYAML-6.0 SQLAlchemy-1.4.47 Werkzeug-2.2.3 absl-py-1.4.0 astunparse-1.6.3 attrs-22.2.0 beautifulsoup4-4.12.0 bs4-0.0.1 cachetools-4.2.4 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.1.0 click-8.1.3 cloudpickle-2.2.1 crcmod-1.7 cryptography-40.0.1 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.3.0 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.1 execnet-1.9.0 fastavro-1.7.3 fasteners-0.18 flatbuffers-23.3.3 freezegun-1.2.2 future-0.18.3 gast-0.4.0 google-api-core-2.11.0 google-apitools-0.5.31 google-auth-2.17.1 google-auth-httplib2-0.1.0 google-auth-oauthlib-1.0.0 google-cloud-bigquery-3.9.0 google-cloud-bigquery-storage-2.19.1 google-cloud-bigtable-2.17.0 google-cloud-core-2.3.2 google-cloud-datastore-2.15.1 google-cloud-dlp-3.12.1 google-cloud-language-2.9.1 google-cloud-pubsub-2.15.2 google-cloud-pubsublite-1.8.1 google-cloud-recommendations-ai-0.10.3 google-cloud-spanner-3.30.0 google-cloud-videointelligence-2.11.1 google-cloud-vision-3.4.1 google-crc32c-1.5.0 google-pasta-0.2.0 google-resumable-media-2.4.1 googleapis-common-protos-1.59.0 greenlet-2.0.2 grpc-google-iam-v1-0.12.6 grpcio-1.53.0 grpcio-status-1.53.0 guppy3-3.1.2 h5py-3.8.0 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.70.2 idna-3.4 importlib-metadata-6.1.0 iniconfig-2.0.0 jax-0.4.8 joblib-1.2.0 keras-2.12.0 libclang-16.0.0 ml-dtypes-0.0.4 mmh3-3.1.0 mock-5.0.1 nltk-3.8.1 nose-1.3.7 numpy-1.23.5 oauth2client-4.1.3 oauthlib-3.2.2 objsize-0.6.1 opt-einsum-3.3.0 orjson-3.8.9 overrides-6.5.0 packaging-23.0 pandas-1.5.3 parameterized-0.8.1 pluggy-1.0.0 proto-plus-1.22.2 protobuf-4.22.1 psycopg2-binary-2.9.6 pyarrow-11.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pymongo-4.3.3 pyparsing-3.0.9 pytest-7.2.2 pytest-timeout-2.1.0 pytest-xdist-3.2.1 python-dateutil-2.8.2 python-snappy-0.6.1 pytz-2023.3 regex-2023.3.23 requests-2.28.2 requests-mock-1.10.0 requests-oauthlib-1.3.1 rsa-4.9 scikit-learn-1.2.2 scipy-1.10.1 six-1.16.0 sortedcontainers-2.4.0 soupsieve-2.4 sqlparse-0.4.3 tenacity-8.2.2 tensorboard-2.12.1 tensorboard-data-server-0.7.0 tensorboard-plugin-wit-1.8.1 tensorflow-2.12.0 tensorflow-estimator-2.12.0 tensorflow-io-gcs-filesystem-0.32.0 termcolor-2.2.0 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 tqdm-4.65.0 typing_extensions-4.5.0 urllib3-1.26.15 websocket-client-1.5.1 wrapt-1.14.1 zipp-3.15.0 zstandard-0.20.0
#8 124.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#8 124.0 WARNING: You are using pip version 22.0.4; however, version 23.1.2 is available.
#8 124.0 You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
#8 126.5 [nltk_data] Downloading package stopwords to /root/nltk_data...
#8 126.5 [nltk_data] Unzipping corpora/stopwords.zip.
#8 126.7 Verified fast protobuf used.
#8 DONE 131.4s
#9 [beam 5/16] RUN pip install --upgrade pip setuptools
#9 1.131 Requirement already satisfied: pip in /usr/local/lib/python3.8/site-packages (22.0.4)
#9 1.314 Collecting pip
#9 1.377 Downloading pip-23.1.2-py3-none-any.whl (2.1 MB)
#9 1.464 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 24.9 MB/s eta 0:00:00
#9 1.482 Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (57.5.0)
#9 1.979 Collecting setuptools
#9 1.997 Downloading setuptools-67.7.2-py3-none-any.whl (1.1 MB)
#9 2.022 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 52.3 MB/s eta 0:00:00
#9 3.216 Installing collected packages: setuptools, pip
#9 3.216 Attempting uninstall: setuptools
#9 3.218 Found existing installation: setuptools 57.5.0
#9 3.276 Uninstalling setuptools-57.5.0:
#9 3.752 Successfully uninstalled setuptools-57.5.0
#9 4.411 Attempting uninstall: pip
#9 4.413 Found existing installation: pip 22.0.4
#9 4.621 Uninstalling pip-22.0.4:
#9 4.846 Successfully uninstalled pip-22.0.4
#9 6.550 Successfully installed pip-23.1.2 setuptools-67.7.2
#9 6.551 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#9 DONE 7.1s
#10 [beam 6/16] RUN mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm google-cloud-sdk.tar.gz
#10 2.632 Welcome to the Google Cloud CLI!
#10 2.687 WARNING: You appear to be running this script as root. This may cause
#10 2.687 the installation to be inaccessible to users other than the root user.
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-1' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy141.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:321)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1313)
at hudson.remoting.Channel$1.handle(Channel.java:606)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
Caused by: Command Close created at
at hudson.remoting.Command.<init>(Command.java:70)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1306)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1304)
at hudson.remoting.Channel.close(Channel.java:1480)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1312)
... 2 more
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-1 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1603
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1603/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230504022043",
"environmentId": "KYjmudAsEIbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-023152"
}
]
},
"name": "go-testxlang_partition-5",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/04 03:16:28 Submitted job: 2023-05-03_20_16_27-10636835133229314865
2023/05/04 03:16:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-03_20_16_27-10636835133229314865?project=apache-beam-testing
2023/05/04 03:16:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-03_20_16_27-10636835133229314865
2023/05/04 03:16:28 Job state: JOB_STATE_PENDING ...
2023/05/04 03:16:58 Job still running ...
2023/05/04 03:17:28 Job still running ...
2023/05/04 03:17:58 Job still running ...
2023/05/04 03:18:28 Job still running ...
2023/05/04 03:18:58 Job still running ...
2023/05/04 03:19:28 Job still running ...
2023/05/04 03:19:58 Job still running ...
2023/05/04 03:20:28 Job still running ...
2023/05/04 03:20:58 Job still running ...
2023/05/04 03:21:28 Job still running ...
2023/05/04 03:21:58 Job still running ...
2023/05/04 03:22:29 Job still running ...
2023/05/04 03:22:59 Job still running ...
2023/05/04 03:23:29 Job still running ...
2023/05/04 03:23:59 Job still running ...
2023/05/04 03:24:29 Job still running ...
2023/05/04 03:24:59 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-03_20_16_27-10636835133229314865 failed
--- FAIL: TestXLang_Partition (551.24s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3182.633s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683167550559057604
--- FAIL: TestBigQueryIO_BasicWriteRead (5.76s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39347 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@otanjNVZiT" is_bounded:BOUNDED windowing_strategy_id:"w0@otanjNVZiT"}} windowing_strategies:{key:"w0@otanjNVZiT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@otanjNVZiT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@otanjNVZiT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@otanjNVZiT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683167550559057604\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"otanjNVZiT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39347 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@otanjNVZiT" is_bounded:BOUNDED windowing_strategy_id:"w0@otanjNVZiT"}} windowing_strategies:{key:"w0@otanjNVZiT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@otanjNVZiT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@otanjNVZiT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@otanjNVZiT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683167550559057604\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"otanjNVZiT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0005104c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0005104c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00016caa0?, 0xc0000c4410?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x10000000001?}, {0xc000489f50, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00016ca00?, 0xc0000c4410?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f50, 0xf}, {0xc00010ec00, 0x52}, {0xf24d60, 0xc000045320})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000501520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000501520, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.791s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.059s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-023152
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-023152
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:71896b05e649716e539b6a0d8f32d89fb0fff8c3c63e1f0d22c0cea159bc9370
Deleted: sha256:e775041d5a30a3ac417f9be9b32f26f4815c1790407b8e1c74cf20fcfffa51c6
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-023152
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:71896b05e649716e539b6a0d8f32d89fb0fff8c3c63e1f0d22c0cea159bc9370
Associated tags:
- 20230504-023152
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-023152
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230504-023152].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:71896b05e649716e539b6a0d8f32d89fb0fff8c3c63e1f0d22c0cea159bc9370].
$ rm -rf /tmp/tmp.ViwhSabv1O
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230504022043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1a1b85e01b169890d37e21318bd797dad020025daf01523d63af8c2ad3bf7e02
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230504022043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1a1b85e01b169890d37e21318bd797dad020025daf01523d63af8c2ad3bf7e02]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230504022043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1a1b85e01b169890d37e21318bd797dad020025daf01523d63af8c2ad3bf7e02])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1a1b85e01b169890d37e21318bd797dad020025daf01523d63af8c2ad3bf7e02
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1a1b85e01b169890d37e21318bd797dad020025daf01523d63af8c2ad3bf7e02
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1a1b85e01b169890d37e21318bd797dad020025daf01523d63af8c2ad3bf7e02].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230504022043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541170a5e97c0a6d82b0699c5336c20be73a1d53d85d4376af098f59ca243e43
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230504022043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541170a5e97c0a6d82b0699c5336c20be73a1d53d85d4376af098f59ca243e43]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230504022043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541170a5e97c0a6d82b0699c5336c20be73a1d53d85d4376af098f59ca243e43])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541170a5e97c0a6d82b0699c5336c20be73a1d53d85d4376af098f59ca243e43
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541170a5e97c0a6d82b0699c5336c20be73a1d53d85d4376af098f59ca243e43
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541170a5e97c0a6d82b0699c5336c20be73a1d53d85d4376af098f59ca243e43].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 395281.
Stopping expansion service pid: 395282.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 14s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/5f6zj7skyr6fk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1602
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1602/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503203036",
"environmentId": "VkePFyXSEobeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-204730"
}
]
},
"name": "go-testxlang_partition-593",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/03 21:35:03 Submitted job: 2023-05-03_14_35_02-3925818119042251273
2023/05/03 21:35:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-03_14_35_02-3925818119042251273?project=apache-beam-testing
2023/05/03 21:35:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-03_14_35_02-3925818119042251273
2023/05/03 21:35:03 Job state: JOB_STATE_PENDING ...
2023/05/03 21:35:33 Job still running ...
2023/05/03 21:36:03 Job still running ...
2023/05/03 21:36:33 Job still running ...
2023/05/03 21:37:03 Job still running ...
2023/05/03 21:37:33 Job still running ...
2023/05/03 21:38:03 Job still running ...
2023/05/03 21:38:33 Job still running ...
2023/05/03 21:39:03 Job still running ...
2023/05/03 21:39:33 Job still running ...
2023/05/03 21:40:04 Job still running ...
2023/05/03 21:40:34 Job still running ...
2023/05/03 21:41:04 Job still running ...
2023/05/03 21:41:34 Job still running ...
2023/05/03 21:42:04 Job still running ...
2023/05/03 21:42:34 Job still running ...
2023/05/03 21:43:04 Job still running ...
2023/05/03 21:43:34 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-03_14_35_02-3925818119042251273 failed
--- FAIL: TestXLang_Partition (566.72s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3309.181s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683146945531428217
--- FAIL: TestBigQueryIO_BasicWriteRead (7.29s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33493 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DVaVsDUVdK" is_bounded:BOUNDED windowing_strategy_id:"w0@DVaVsDUVdK"}} windowing_strategies:{key:"w0@DVaVsDUVdK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DVaVsDUVdK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DVaVsDUVdK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DVaVsDUVdK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683146945531428217\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DVaVsDUVdK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33493 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DVaVsDUVdK" is_bounded:BOUNDED windowing_strategy_id:"w0@DVaVsDUVdK"}} windowing_strategies:{key:"w0@DVaVsDUVdK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DVaVsDUVdK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DVaVsDUVdK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DVaVsDUVdK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683146945531428217\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DVaVsDUVdK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc000460800})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc000460800})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005c6100?, 0xc0005dc000?}, {0x11c8c7d, 0x39}, {0xc0001d0180?, 0x10c85c0?, 0x41bc91?}, {0xc000501f80, 0xf}, 0xc000325d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005c6080?, 0xc0005dc000?}, {0xc000050900, 0x52}, {0x1?}, {0xc000325ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000501f80, 0xf}, {0xc000050900, 0x52}, {0xf24d60, 0xc0001a8078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103860, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 10.327s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.084s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8fc80a88d4e10ac8d83c8141b0af2cb2a94ef032b9cb4bf59495743818bcd67e
Associated tags:
- 20230503-204730
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-204730
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-204730].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8fc80a88d4e10ac8d83c8141b0af2cb2a94ef032b9cb4bf59495743818bcd67e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503203036]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:15e9d5c0f8468591e0c0e86f5ff141f9006c01406dc0211e0f3eafab6eeff61f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503203036] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:15e9d5c0f8468591e0c0e86f5ff141f9006c01406dc0211e0f3eafab6eeff61f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:15e9d5c0f8468591e0c0e86f5ff141f9006c01406dc0211e0f3eafab6eeff61f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:15e9d5c0f8468591e0c0e86f5ff141f9006c01406dc0211e0f3eafab6eeff61f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503203036]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db6e018f54b057175c90ea2fb26118e3a296d910edbd7cd57db48ba6ad91073f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503203036] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db6e018f54b057175c90ea2fb26118e3a296d910edbd7cd57db48ba6ad91073f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db6e018f54b057175c90ea2fb26118e3a296d910edbd7cd57db48ba6ad91073f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db6e018f54b057175c90ea2fb26118e3a296d910edbd7cd57db48ba6ad91073f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 14m 27s
232 actionable tasks: 164 executed, 56 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/zrx6pde2gcldc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1601
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1601/display/redirect?page=changes>
Changes:
[noreply] Use vendor guava for sdks/java/extensions/sql (#26463)
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503142334",
"environmentId": "VWPwBmoHGlbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-143512"
}
]
},
"name": "go-testxlang_partition-466",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/03 15:13:37 Submitted job: 2023-05-03_08_13_36-7225548713448617806
2023/05/03 15:13:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-03_08_13_36-7225548713448617806?project=apache-beam-testing
2023/05/03 15:13:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-03_08_13_36-7225548713448617806
2023/05/03 15:13:37 Job state: JOB_STATE_PENDING ...
2023/05/03 15:14:07 Job still running ...
2023/05/03 15:14:37 Job still running ...
2023/05/03 15:15:07 Job still running ...
2023/05/03 15:15:37 Job still running ...
2023/05/03 15:16:07 Job still running ...
2023/05/03 15:16:37 Job still running ...
2023/05/03 15:17:07 Job still running ...
2023/05/03 15:17:37 Job still running ...
2023/05/03 15:18:07 Job still running ...
2023/05/03 15:18:37 Job still running ...
2023/05/03 15:19:07 Job still running ...
2023/05/03 15:19:37 Job still running ...
2023/05/03 15:20:07 Job still running ...
2023/05/03 15:20:37 Job still running ...
2023/05/03 15:21:07 Job still running ...
2023/05/03 15:21:37 Job still running ...
2023/05/03 15:22:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-03_08_13_36-7225548713448617806 failed
--- FAIL: TestXLang_Partition (551.83s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2813.171s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683124552170900945
--- FAIL: TestBigQueryIO_BasicWriteRead (5.57s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46123 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qqsRkSBoZq" is_bounded:BOUNDED windowing_strategy_id:"w0@qqsRkSBoZq"}} windowing_strategies:{key:"w0@qqsRkSBoZq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qqsRkSBoZq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qqsRkSBoZq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qqsRkSBoZq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683124552170900945\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qqsRkSBoZq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46123 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qqsRkSBoZq" is_bounded:BOUNDED windowing_strategy_id:"w0@qqsRkSBoZq"}} windowing_strategies:{key:"w0@qqsRkSBoZq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qqsRkSBoZq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qqsRkSBoZq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qqsRkSBoZq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683124552170900945\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qqsRkSBoZq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 6 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc000690880})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc000690880})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006a6fc0?, 0xc00061a410?}, {0x11c8c7d, 0x39}, {0xc0001c4180?, 0x10c85c0?, 0x1?}, {0xc0004f7f80, 0xf}, 0xc000307d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006a6f40?, 0xc00061a410?}, {0xc00019aba0, 0x52}, {0x1?}, {0xc000307ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0004f7f80, 0xf}, {0xc00019aba0, 0x52}, {0xf24d60, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103040, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.594s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-143512
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-143512
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a52b111e7d4bd8bed25e5a215861e6d14f901aac8be1088aa37184949a38b02
Deleted: sha256:a322b9bb93dc29bae55cea2b5e451c590002955bce2c448896b59fb785d9a26b
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-143512
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a52b111e7d4bd8bed25e5a215861e6d14f901aac8be1088aa37184949a38b02
Associated tags:
- 20230503-143512
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-143512
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-143512].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6a52b111e7d4bd8bed25e5a215861e6d14f901aac8be1088aa37184949a38b02].
$ rm -rf /tmp/tmp.PA0xGeHPcS
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503142334
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:03ed7bbeb806369e2df61ac61bd432f971d7d20379d0595b4422ba5cd21e4166
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503142334]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:03ed7bbeb806369e2df61ac61bd432f971d7d20379d0595b4422ba5cd21e4166]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503142334] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:03ed7bbeb806369e2df61ac61bd432f971d7d20379d0595b4422ba5cd21e4166])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:03ed7bbeb806369e2df61ac61bd432f971d7d20379d0595b4422ba5cd21e4166
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:03ed7bbeb806369e2df61ac61bd432f971d7d20379d0595b4422ba5cd21e4166
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:03ed7bbeb806369e2df61ac61bd432f971d7d20379d0595b4422ba5cd21e4166].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503142334
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d33240468c120e16463283eb7df39383889ab2e4e6c7213b99341d0cc5b55401
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503142334]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d33240468c120e16463283eb7df39383889ab2e4e6c7213b99341d0cc5b55401]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503142334] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d33240468c120e16463283eb7df39383889ab2e4e6c7213b99341d0cc5b55401])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d33240468c120e16463283eb7df39383889ab2e4e6c7213b99341d0cc5b55401
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d33240468c120e16463283eb7df39383889ab2e4e6c7213b99341d0cc5b55401
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d33240468c120e16463283eb7df39383889ab2e4e6c7213b99341d0cc5b55401].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3719337.
Stopping expansion service pid: 3719338.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/6v25mjcwnnqda
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1600
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1600/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503082031",
"environmentId": "mgSlERHErAbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-083054"
}
]
},
"name": "go-testxlang_partition-129",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/03 09:17:29 Submitted job: 2023-05-03_02_17_28-10027786417145574465
2023/05/03 09:17:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-03_02_17_28-10027786417145574465?project=apache-beam-testing
2023/05/03 09:17:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-03_02_17_28-10027786417145574465
2023/05/03 09:17:29 Job state: JOB_STATE_PENDING ...
2023/05/03 09:17:59 Job still running ...
2023/05/03 09:18:30 Job still running ...
2023/05/03 09:19:00 Job still running ...
2023/05/03 09:19:30 Job still running ...
2023/05/03 09:20:00 Job still running ...
2023/05/03 09:20:30 Job still running ...
2023/05/03 09:21:00 Job still running ...
2023/05/03 09:21:30 Job still running ...
2023/05/03 09:22:00 Job still running ...
2023/05/03 09:22:30 Job still running ...
2023/05/03 09:23:00 Job still running ...
2023/05/03 09:23:30 Job still running ...
2023/05/03 09:24:00 Job still running ...
2023/05/03 09:24:30 Job still running ...
2023/05/03 09:25:00 Job still running ...
2023/05/03 09:25:30 Job still running ...
2023/05/03 09:26:00 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-03_02_17_28-10027786417145574465 failed
--- FAIL: TestXLang_Partition (553.10s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3304.148s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683102690019463282
--- FAIL: TestBigQueryIO_BasicWriteRead (4.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45529 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@GDORoRgixh" is_bounded:BOUNDED windowing_strategy_id:"w0@GDORoRgixh"}} windowing_strategies:{key:"w0@GDORoRgixh" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@GDORoRgixh" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@GDORoRgixh" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@GDORoRgixh" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683102690019463282\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"GDORoRgixh"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45529 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@GDORoRgixh" is_bounded:BOUNDED windowing_strategy_id:"w0@GDORoRgixh"}} windowing_strategies:{key:"w0@GDORoRgixh" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@GDORoRgixh" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@GDORoRgixh" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@GDORoRgixh" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683102690019463282\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"GDORoRgixh"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0005febc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0005febc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae180?, 0xc00058c000?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x41bc91?}, {0xc000489f50, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae100?, 0xc00058c000?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f50, 0xf}, {0xc00010ec00, 0x52}, {0xf24d60, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003511e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003511e0, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.468s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-083054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-083054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6c9d5aa87b17fe3371c7146d78f6f1f0c0769632fece82a849c26fc0a508ed84
Deleted: sha256:af5ff59fbaad900b853114597a581a20322528b426f13b655b0002ad511ba5ff
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-083054
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6c9d5aa87b17fe3371c7146d78f6f1f0c0769632fece82a849c26fc0a508ed84
Associated tags:
- 20230503-083054
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-083054
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-083054].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6c9d5aa87b17fe3371c7146d78f6f1f0c0769632fece82a849c26fc0a508ed84].
$ rm -rf /tmp/tmp.4t1vtL1Ia2
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503082031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6b4c414b95d54739fab48f912c72dcd2122f0f700a70cc5f530bd7cbebe40b7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6b4c414b95d54739fab48f912c72dcd2122f0f700a70cc5f530bd7cbebe40b7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6b4c414b95d54739fab48f912c72dcd2122f0f700a70cc5f530bd7cbebe40b7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6b4c414b95d54739fab48f912c72dcd2122f0f700a70cc5f530bd7cbebe40b7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6b4c414b95d54739fab48f912c72dcd2122f0f700a70cc5f530bd7cbebe40b7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6b4c414b95d54739fab48f912c72dcd2122f0f700a70cc5f530bd7cbebe40b7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503082031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:35a006435a38aabe3419b10e6ad0c29a80e7efd5060dbb8284eefd9723328f5b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:35a006435a38aabe3419b10e6ad0c29a80e7efd5060dbb8284eefd9723328f5b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:35a006435a38aabe3419b10e6ad0c29a80e7efd5060dbb8284eefd9723328f5b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:35a006435a38aabe3419b10e6ad0c29a80e7efd5060dbb8284eefd9723328f5b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:35a006435a38aabe3419b10e6ad0c29a80e7efd5060dbb8284eefd9723328f5b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:35a006435a38aabe3419b10e6ad0c29a80e7efd5060dbb8284eefd9723328f5b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2059051.
Stopping expansion service pid: 2059052.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 26s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/vwtyk2nbyf5vg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1599
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1599/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503022034",
"environmentId": "bWMhErnBhSbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-023206"
}
]
},
"name": "go-testxlang_partition-448",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/03 03:17:46 Submitted job: 2023-05-02_20_17_45-2480864824681282110
2023/05/03 03:17:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-02_20_17_45-2480864824681282110?project=apache-beam-testing
2023/05/03 03:17:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-02_20_17_45-2480864824681282110
2023/05/03 03:17:46 Job state: JOB_STATE_PENDING ...
2023/05/03 03:18:16 Job still running ...
2023/05/03 03:18:46 Job still running ...
2023/05/03 03:19:16 Job still running ...
2023/05/03 03:19:46 Job still running ...
2023/05/03 03:20:16 Job still running ...
2023/05/03 03:20:46 Job still running ...
2023/05/03 03:21:16 Job still running ...
2023/05/03 03:21:46 Job still running ...
2023/05/03 03:22:16 Job still running ...
2023/05/03 03:22:46 Job still running ...
2023/05/03 03:23:16 Job still running ...
2023/05/03 03:23:46 Job still running ...
2023/05/03 03:24:16 Job still running ...
2023/05/03 03:24:46 Job still running ...
2023/05/03 03:25:16 Job still running ...
2023/05/03 03:25:47 Job still running ...
2023/05/03 03:26:17 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-02_20_17_45-2480864824681282110 failed
--- FAIL: TestXLang_Partition (550.36s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3242.615s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683081171760074511
--- FAIL: TestBigQueryIO_BasicWriteRead (5.24s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46813 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vLwPZzZglV" is_bounded:BOUNDED windowing_strategy_id:"w0@vLwPZzZglV"}} windowing_strategies:{key:"w0@vLwPZzZglV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vLwPZzZglV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vLwPZzZglV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vLwPZzZglV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683081171760074511\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vLwPZzZglV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46813 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vLwPZzZglV" is_bounded:BOUNDED windowing_strategy_id:"w0@vLwPZzZglV"}} windowing_strategies:{key:"w0@vLwPZzZglV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vLwPZzZglV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vLwPZzZglV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vLwPZzZglV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683081171760074511\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vLwPZzZglV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 29 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0003d6440})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0003d6440})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00016cb80?, 0xc000136320?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x1?}, {0xc000045f50, 0xf}, 0xc0002d3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00016cae0?, 0xc000136320?}, {0xc0000509c0, 0x52}, {0x1?}, {0xc0002d3ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc0000509c0, 0x52}, {0xf24d60, 0xc000489340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000d9040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000d9040, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.267s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.035s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:13e03a2bb5869ac7bf2eeb2b329dcd8ff617b9d3a582ce1510616bb3f89390f6
Associated tags:
- 20230503-023206
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-023206
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230503-023206].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:13e03a2bb5869ac7bf2eeb2b329dcd8ff617b9d3a582ce1510616bb3f89390f6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503022034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1ce51fd3aa68c4fe8ffc69e63cac4c95f505832c2d826ecadf24c4864a91ae2b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230503022034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1ce51fd3aa68c4fe8ffc69e63cac4c95f505832c2d826ecadf24c4864a91ae2b])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1ce51fd3aa68c4fe8ffc69e63cac4c95f505832c2d826ecadf24c4864a91ae2b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1ce51fd3aa68c4fe8ffc69e63cac4c95f505832c2d826ecadf24c4864a91ae2b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503022034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eb1c05cb7f9b57ca1ac2d8f23682b708c25108229d1201456ad2a13802156f9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230503022034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eb1c05cb7f9b57ca1ac2d8f23682b708c25108229d1201456ad2a13802156f9])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eb1c05cb7f9b57ca1ac2d8f23682b708c25108229d1201456ad2a13802156f9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eb1c05cb7f9b57ca1ac2d8f23682b708c25108229d1201456ad2a13802156f9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 42s
232 actionable tasks: 162 executed, 58 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/kfqxagndl6vvc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1598
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1598/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-203645",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-203645"
}
]
},
"name": "go-testxlang_partition-507",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/02 21:22:32 Submitted job: 2023-05-02_14_22_32-78923623143777493
2023/05/02 21:22:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-02_14_22_32-78923623143777493?project=apache-beam-testing
2023/05/02 21:22:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-02_14_22_32-78923623143777493
2023/05/02 21:22:32 Job state: JOB_STATE_PENDING ...
2023/05/02 21:23:02 Job still running ...
2023/05/02 21:23:32 Job still running ...
2023/05/02 21:24:02 Job still running ...
2023/05/02 21:24:32 Job still running ...
2023/05/02 21:25:03 Job still running ...
2023/05/02 21:25:33 Job still running ...
2023/05/02 21:26:03 Job still running ...
2023/05/02 21:26:33 Job still running ...
2023/05/02 21:27:03 Job still running ...
2023/05/02 21:27:33 Job still running ...
2023/05/02 21:28:03 Job still running ...
2023/05/02 21:28:33 Job still running ...
2023/05/02 21:29:03 Job still running ...
2023/05/02 21:29:33 Job still running ...
2023/05/02 21:30:03 Job still running ...
2023/05/02 21:30:33 Job still running ...
2023/05/02 21:31:03 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-02_14_22_32-78923623143777493 failed
--- FAIL: TestXLang_Partition (551.03s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3225.241s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683059879846220102
--- FAIL: TestBigQueryIO_BasicWriteRead (10.08s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38501 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@fnsAqOZQBn" is_bounded:BOUNDED windowing_strategy_id:"w0@fnsAqOZQBn"}} windowing_strategies:{key:"w0@fnsAqOZQBn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@fnsAqOZQBn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@fnsAqOZQBn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@fnsAqOZQBn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683059879846220102\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"fnsAqOZQBn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38501 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@fnsAqOZQBn" is_bounded:BOUNDED windowing_strategy_id:"w0@fnsAqOZQBn"}} windowing_strategies:{key:"w0@fnsAqOZQBn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@fnsAqOZQBn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@fnsAqOZQBn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@fnsAqOZQBn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683059879846220102\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"fnsAqOZQBn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc000520880})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc000520880})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000724fe0?, 0xc0000c5770?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x1?}, {0xc000045000, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000724f60?, 0xc0000c5770?}, {0xc000050600, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045000, 0xf}, {0xc000050600, 0x52}, {0xf24d60, 0xc000488320})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503380, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 13.169s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.111s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.116s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.091s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-203645
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-203645
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ae291b6998fa52f575c68690078c9fde7495ee82372474b2576e8d9150d268ce
Deleted: sha256:410b0a4f47133b4197e73914f74e926ec3be6f084d295305aa8cd52eb157c6f3
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-203645
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ae291b6998fa52f575c68690078c9fde7495ee82372474b2576e8d9150d268ce
Associated tags:
- 20230502-203645
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-203645
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-203645].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ae291b6998fa52f575c68690078c9fde7495ee82372474b2576e8d9150d268ce].
$ rm -rf /tmp/tmp.yCPV3eXDpa
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502202038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46339de27de454f11920dfc502e85b5ae0fef6f6f459a4a365e8127fe1ac6fa6
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502202038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46339de27de454f11920dfc502e85b5ae0fef6f6f459a4a365e8127fe1ac6fa6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502202038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46339de27de454f11920dfc502e85b5ae0fef6f6f459a4a365e8127fe1ac6fa6])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46339de27de454f11920dfc502e85b5ae0fef6f6f459a4a365e8127fe1ac6fa6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46339de27de454f11920dfc502e85b5ae0fef6f6f459a4a365e8127fe1ac6fa6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46339de27de454f11920dfc502e85b5ae0fef6f6f459a4a365e8127fe1ac6fa6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502202038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7553aef9e5714a5a4778d648bb681490edc10c1de64b45b13e188c7e0ecfd8e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502202038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7553aef9e5714a5a4778d648bb681490edc10c1de64b45b13e188c7e0ecfd8e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502202038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7553aef9e5714a5a4778d648bb681490edc10c1de64b45b13e188c7e0ecfd8e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7553aef9e5714a5a4778d648bb681490edc10c1de64b45b13e188c7e0ecfd8e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7553aef9e5714a5a4778d648bb681490edc10c1de64b45b13e188c7e0ecfd8e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7553aef9e5714a5a4778d648bb681490edc10c1de64b45b13e188c7e0ecfd8e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3225799.
Stopping expansion service pid: 3225800.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 11m 31s
232 actionable tasks: 164 executed, 56 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/o3bllz5g2fpmm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1597
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1597/display/redirect?page=changes>
Changes:
[noreply] [Playground] Make fields "categories" and "context_line" optional in
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502142032",
"environmentId": "pkHUENcwnubeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-143129"
}
]
},
"name": "go-testxlang_partition-475",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/02 15:18:11 Submitted job: 2023-05-02_08_18_10-16668280981632451590
2023/05/02 15:18:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-02_08_18_10-16668280981632451590?project=apache-beam-testing
2023/05/02 15:18:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-02_08_18_10-16668280981632451590
2023/05/02 15:18:11 Job state: JOB_STATE_PENDING ...
2023/05/02 15:18:41 Job still running ...
2023/05/02 15:19:11 Job still running ...
2023/05/02 15:19:41 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-02_08_18_10-16668280981632451590 failed
--- FAIL: TestXLang_Partition (131.08s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2888.227s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683037931029692238
--- FAIL: TestBigQueryIO_BasicWriteRead (5.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38871 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kHMflPhdYO" is_bounded:BOUNDED windowing_strategy_id:"w0@kHMflPhdYO"}} windowing_strategies:{key:"w0@kHMflPhdYO" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kHMflPhdYO" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kHMflPhdYO" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kHMflPhdYO" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683037931029692238\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kHMflPhdYO"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38871 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kHMflPhdYO" is_bounded:BOUNDED windowing_strategy_id:"w0@kHMflPhdYO"}} windowing_strategies:{key:"w0@kHMflPhdYO" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kHMflPhdYO" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kHMflPhdYO" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kHMflPhdYO" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683037931029692238\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kHMflPhdYO"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 51 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc00066eb80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc00066eb80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003e20a0?, 0xc0000c4050?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x41bc91?}, {0xc000489f80, 0xf}, 0xc0002e7d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003e2020?, 0xc0000c4050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc0002e7ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010ec00, 0x52}, {0xf24d60, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000351860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000351860, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.356s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.041s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-143129
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-143129
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f1fd25f60d685a40620399522c9c87567b6cb0a74ce0dc54068d4b0967709852
Deleted: sha256:9dddab11039b4d3dfcf1504be74db90e406c465917f00ccfa72cbf5b5851d4cb
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-143129
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f1fd25f60d685a40620399522c9c87567b6cb0a74ce0dc54068d4b0967709852
Associated tags:
- 20230502-143129
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-143129
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-143129].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f1fd25f60d685a40620399522c9c87567b6cb0a74ce0dc54068d4b0967709852].
$ rm -rf /tmp/tmp.IxcquB2eRe
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502142032
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:028d10d73074c1a99d171f2a501f54bf670f63c00440cc44527dfff32eb98ad6
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502142032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:028d10d73074c1a99d171f2a501f54bf670f63c00440cc44527dfff32eb98ad6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502142032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:028d10d73074c1a99d171f2a501f54bf670f63c00440cc44527dfff32eb98ad6])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:028d10d73074c1a99d171f2a501f54bf670f63c00440cc44527dfff32eb98ad6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:028d10d73074c1a99d171f2a501f54bf670f63c00440cc44527dfff32eb98ad6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:028d10d73074c1a99d171f2a501f54bf670f63c00440cc44527dfff32eb98ad6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502142032
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dfa01b05e640dac8dc9e42e38141a39734a865f5f3f1797391ea952f3f65082
Deleted: sha256:79b407a9b0bc6cf147afd663924f27a8fffa470f04a43aa390baeb2f060bcb08
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502142032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dfa01b05e640dac8dc9e42e38141a39734a865f5f3f1797391ea952f3f65082]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502142032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dfa01b05e640dac8dc9e42e38141a39734a865f5f3f1797391ea952f3f65082])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dfa01b05e640dac8dc9e42e38141a39734a865f5f3f1797391ea952f3f65082
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dfa01b05e640dac8dc9e42e38141a39734a865f5f3f1797391ea952f3f65082
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dfa01b05e640dac8dc9e42e38141a39734a865f5f3f1797391ea952f3f65082].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2686640.
Stopping expansion service pid: 2686641.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6s
232 actionable tasks: 168 executed, 52 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/mnjx6w2pmcuks
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1596
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1596/display/redirect>
Changes:
------------------------------------------
[...truncated 1.07 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502082043",
"environmentId": "IyHTeKNRUjbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-083230"
}
]
},
"name": "go-testxlang_partition-577",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/02 09:17:09 Submitted job: 2023-05-02_02_17_08-11962955253495501536
2023/05/02 09:17:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-02_02_17_08-11962955253495501536?project=apache-beam-testing
2023/05/02 09:17:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-02_02_17_08-11962955253495501536
2023/05/02 09:17:10 Job state: JOB_STATE_PENDING ...
2023/05/02 09:17:40 Job still running ...
2023/05/02 09:18:10 Job still running ...
2023/05/02 09:18:40 Job still running ...
2023/05/02 09:19:10 Job still running ...
2023/05/02 09:19:40 Job still running ...
2023/05/02 09:20:10 Job still running ...
2023/05/02 09:20:40 Job still running ...
2023/05/02 09:21:10 Job still running ...
2023/05/02 09:21:40 Job still running ...
2023/05/02 09:22:10 Job still running ...
2023/05/02 09:22:40 Job still running ...
2023/05/02 09:23:10 Job still running ...
2023/05/02 09:23:40 Job still running ...
2023/05/02 09:24:10 Job still running ...
2023/05/02 09:24:40 Job still running ...
2023/05/02 09:25:10 Job still running ...
2023/05/02 09:25:40 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-02_02_17_08-11962955253495501536 failed
--- FAIL: TestXLang_Partition (553.17s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3184.073s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683016390030490356
--- FAIL: TestBigQueryIO_BasicWriteRead (4.41s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39423 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KtnqOUEFYZ" is_bounded:BOUNDED windowing_strategy_id:"w0@KtnqOUEFYZ"}} windowing_strategies:{key:"w0@KtnqOUEFYZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KtnqOUEFYZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KtnqOUEFYZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KtnqOUEFYZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683016390030490356\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KtnqOUEFYZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39423 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KtnqOUEFYZ" is_bounded:BOUNDED windowing_strategy_id:"w0@KtnqOUEFYZ"}} windowing_strategies:{key:"w0@KtnqOUEFYZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KtnqOUEFYZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KtnqOUEFYZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KtnqOUEFYZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1683016390030490356\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KtnqOUEFYZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc000660940})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc000660940})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00068a140?, 0xc0004f4000?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x41bc91?}, {0xc000489f60, 0xf}, 0xc0002abd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00068a0c0?, 0xc0004f4000?}, {0xc0000509c0, 0x52}, {0x1?}, {0xc0002abea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f60, 0xf}, {0xc0000509c0, 0x52}, {0xf24d60, 0xc0006b4028})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.443s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-083230
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-083230
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a3697dcb0f55ab20c2a92d9089eb0417b40dac9aa1ad2f3ce49a429e921381a1
Deleted: sha256:247ad91a631c75997d3969e5c25e89c334df24d72a761fd1072debbcf65ea81c
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-083230
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a3697dcb0f55ab20c2a92d9089eb0417b40dac9aa1ad2f3ce49a429e921381a1
Associated tags:
- 20230502-083230
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-083230
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-083230].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a3697dcb0f55ab20c2a92d9089eb0417b40dac9aa1ad2f3ce49a429e921381a1].
$ rm -rf /tmp/tmp.KReuQiiPco
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502082043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:565f2342b485dbfb7e914fd53f7018cf249a8309237c45fbda831c179b6df3c9
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502082043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:565f2342b485dbfb7e914fd53f7018cf249a8309237c45fbda831c179b6df3c9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502082043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:565f2342b485dbfb7e914fd53f7018cf249a8309237c45fbda831c179b6df3c9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:565f2342b485dbfb7e914fd53f7018cf249a8309237c45fbda831c179b6df3c9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:565f2342b485dbfb7e914fd53f7018cf249a8309237c45fbda831c179b6df3c9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:565f2342b485dbfb7e914fd53f7018cf249a8309237c45fbda831c179b6df3c9].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502082043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61c49d16fbe6b1872431a0c7bb18f861f8d4137cb1d0b7160950858a19f3df5b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502082043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61c49d16fbe6b1872431a0c7bb18f861f8d4137cb1d0b7160950858a19f3df5b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502082043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61c49d16fbe6b1872431a0c7bb18f861f8d4137cb1d0b7160950858a19f3df5b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61c49d16fbe6b1872431a0c7bb18f861f8d4137cb1d0b7160950858a19f3df5b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61c49d16fbe6b1872431a0c7bb18f861f8d4137cb1d0b7160950858a19f3df5b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61c49d16fbe6b1872431a0c7bb18f861f8d4137cb1d0b7160950858a19f3df5b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 425963.
Stopping expansion service pid: 425964.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 56s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/5rkrfy775sga4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1595
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1595/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502022044",
"environmentId": "OcSntotqtKbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-023139",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-023139"
}
]
},
"name": "go-testxlang_partition-161",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/02 03:17:09 Submitted job: 2023-05-01_20_17_09-14986939609354037747
2023/05/02 03:17:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-01_20_17_09-14986939609354037747?project=apache-beam-testing
2023/05/02 03:17:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-01_20_17_09-14986939609354037747
2023/05/02 03:17:09 Job state: JOB_STATE_PENDING ...
2023/05/02 03:17:39 Job still running ...
2023/05/02 03:18:09 Job still running ...
2023/05/02 03:18:40 Job still running ...
2023/05/02 03:19:10 Job still running ...
2023/05/02 03:19:40 Job still running ...
2023/05/02 03:20:10 Job still running ...
2023/05/02 03:20:43 Job still running ...
2023/05/02 03:21:13 Job still running ...
2023/05/02 03:21:43 Job still running ...
2023/05/02 03:22:13 Job still running ...
2023/05/02 03:22:43 Job still running ...
2023/05/02 03:23:13 Job still running ...
2023/05/02 03:23:43 Job still running ...
2023/05/02 03:24:13 Job still running ...
2023/05/02 03:24:43 Job still running ...
2023/05/02 03:25:13 Job still running ...
2023/05/02 03:25:46 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-01_20_17_09-14986939609354037747 failed
--- FAIL: TestXLang_Partition (557.43s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3245.468s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682994734923352034
--- FAIL: TestBigQueryIO_BasicWriteRead (4.84s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42195 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hCwAtAREvQ" is_bounded:BOUNDED windowing_strategy_id:"w0@hCwAtAREvQ"}} windowing_strategies:{key:"w0@hCwAtAREvQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hCwAtAREvQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hCwAtAREvQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hCwAtAREvQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682994734923352034\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hCwAtAREvQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42195 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hCwAtAREvQ" is_bounded:BOUNDED windowing_strategy_id:"w0@hCwAtAREvQ"}} windowing_strategies:{key:"w0@hCwAtAREvQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hCwAtAREvQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hCwAtAREvQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hCwAtAREvQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682994734923352034\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hCwAtAREvQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0002d0bc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0002d0bc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005cc0e0?, 0xc0000c4280?}, {0x11c8c7d, 0x39}, {0xc0000f6180?, 0x10c85c0?, 0x41bc91?}, {0xc00046dbf0, 0xf}, 0xc000563d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005cc060?, 0xc0000c4280?}, {0xc0001387e0, 0x52}, {0x1?}, {0xc000563ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dbf0, 0xf}, {0xc0001387e0, 0x52}, {0xf24d60, 0xc0005a20f8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103ba0, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.865s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:660d598018d7708e671bd64061b4f005b5ed8412fc5505cea3db584101005d54
Associated tags:
- 20230502-023139
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-023139
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230502-023139].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:660d598018d7708e671bd64061b4f005b5ed8412fc5505cea3db584101005d54].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502022044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3399f5cf67a15cc4a9bcfcb43f4f06e8d5a0362e90b41b7d567ef651c9afee9b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230502022044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3399f5cf67a15cc4a9bcfcb43f4f06e8d5a0362e90b41b7d567ef651c9afee9b])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3399f5cf67a15cc4a9bcfcb43f4f06e8d5a0362e90b41b7d567ef651c9afee9b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3399f5cf67a15cc4a9bcfcb43f4f06e8d5a0362e90b41b7d567ef651c9afee9b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502022044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:75f7125cda6ce39d37464f86a153b0338655c1f910057d77e97abebf1f5e2546]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230502022044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:75f7125cda6ce39d37464f86a153b0338655c1f910057d77e97abebf1f5e2546])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:75f7125cda6ce39d37464f86a153b0338655c1f910057d77e97abebf1f5e2546
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:75f7125cda6ce39d37464f86a153b0338655c1f910057d77e97abebf1f5e2546].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 1s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/nnjphu3meqajm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1594
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1594/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501202124",
"environmentId": "CQNpTUmOADbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-204705"
}
]
},
"name": "go-testxlang_partition-307",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/01 21:36:11 Submitted job: 2023-05-01_14_36_11-14086096411516170531
2023/05/01 21:36:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-01_14_36_11-14086096411516170531?project=apache-beam-testing
2023/05/01 21:36:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-01_14_36_11-14086096411516170531
2023/05/01 21:36:11 Job state: JOB_STATE_PENDING ...
2023/05/01 21:36:41 Job still running ...
2023/05/01 21:37:11 Job still running ...
2023/05/01 21:37:41 Job still running ...
2023/05/01 21:38:11 Job still running ...
2023/05/01 21:38:41 Job still running ...
2023/05/01 21:39:11 Job still running ...
2023/05/01 21:39:41 Job still running ...
2023/05/01 21:40:12 Job still running ...
2023/05/01 21:40:42 Job still running ...
2023/05/01 21:41:12 Job still running ...
2023/05/01 21:41:42 Job still running ...
2023/05/01 21:42:12 Job still running ...
2023/05/01 21:42:42 Job still running ...
2023/05/01 21:43:12 Job still running ...
2023/05/01 21:43:42 Job still running ...
2023/05/01 21:44:12 Job still running ...
2023/05/01 21:44:42 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-01_14_36_11-14086096411516170531 failed
--- FAIL: TestXLang_Partition (550.61s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3411.442s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682974113100472919
--- FAIL: TestBigQueryIO_BasicWriteRead (11.81s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34751 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DbLLipzQpH" is_bounded:BOUNDED windowing_strategy_id:"w0@DbLLipzQpH"}} windowing_strategies:{key:"w0@DbLLipzQpH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DbLLipzQpH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DbLLipzQpH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DbLLipzQpH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682974113100472919\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DbLLipzQpH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34751 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DbLLipzQpH" is_bounded:BOUNDED windowing_strategy_id:"w0@DbLLipzQpH"}} windowing_strategies:{key:"w0@DbLLipzQpH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DbLLipzQpH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DbLLipzQpH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DbLLipzQpH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682974113100472919\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DbLLipzQpH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 20 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0006fa7c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0006fa7c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00028c160?, 0xc000136230?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x41bc91?}, {0xc000045f00, 0xf}, 0xc00002bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00028c0e0?, 0xc000136230?}, {0xc000050900, 0x52}, {0x1?}, {0xc00002bea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f00, 0xf}, {0xc000050900, 0x52}, {0xf24d60, 0xc000282068})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00050ab60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00050ab60, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 14.905s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.119s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.108s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.131s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-204705
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-204705
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:534c52bd23c85eb2863eba67e1ce4ceac8422e6a7c115cbe8ed0d21532277972
Deleted: sha256:38883b03c84c51e7798af5c764cd41c7507b3401c6c649205e07ea717dd49740
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-204705
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:534c52bd23c85eb2863eba67e1ce4ceac8422e6a7c115cbe8ed0d21532277972
Associated tags:
- 20230501-204705
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-204705
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-204705].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:534c52bd23c85eb2863eba67e1ce4ceac8422e6a7c115cbe8ed0d21532277972].
$ rm -rf /tmp/tmp.p9v6Bi4uJE
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501202124
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bc7ec87d9744acb690453b323eae2c5bb63ece55763632a0210c0523f32ca498
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501202124]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bc7ec87d9744acb690453b323eae2c5bb63ece55763632a0210c0523f32ca498]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501202124] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bc7ec87d9744acb690453b323eae2c5bb63ece55763632a0210c0523f32ca498])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bc7ec87d9744acb690453b323eae2c5bb63ece55763632a0210c0523f32ca498
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bc7ec87d9744acb690453b323eae2c5bb63ece55763632a0210c0523f32ca498
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bc7ec87d9744acb690453b323eae2c5bb63ece55763632a0210c0523f32ca498].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501202124
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8a719ee25c1bb79cb5de6e98ffaa2c91628afcb665b2c76c9a8941b88dd976e5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501202124]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8a719ee25c1bb79cb5de6e98ffaa2c91628afcb665b2c76c9a8941b88dd976e5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501202124] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8a719ee25c1bb79cb5de6e98ffaa2c91628afcb665b2c76c9a8941b88dd976e5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8a719ee25c1bb79cb5de6e98ffaa2c91628afcb665b2c76c9a8941b88dd976e5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8a719ee25c1bb79cb5de6e98ffaa2c91628afcb665b2c76c9a8941b88dd976e5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8a719ee25c1bb79cb5de6e98ffaa2c91628afcb665b2c76c9a8941b88dd976e5].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 9730.
Stopping expansion service pid: 9731.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 24m 44s
232 actionable tasks: 196 executed, 24 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/oyvziuchonrpm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1593
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1593/display/redirect?page=changes>
Changes:
[noreply] [Python] Add saved_weights example to tf notebook (#26472)
------------------------------------------
[...truncated 1021.26 KB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501142546",
"environmentId": "NLtUTLuWDFbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-143716"
}
]
},
"name": "go-testxlang_partition-761",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/01 15:23:45 Submitted job: 2023-05-01_08_23_44-9199968007446113455
2023/05/01 15:23:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-01_08_23_44-9199968007446113455?project=apache-beam-testing
2023/05/01 15:23:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-01_08_23_44-9199968007446113455
2023/05/01 15:23:45 Job state: JOB_STATE_PENDING ...
2023/05/01 15:24:15 Job still running ...
2023/05/01 15:24:45 Job still running ...
2023/05/01 15:25:15 Job still running ...
2023/05/01 15:25:45 Job still running ...
2023/05/01 15:26:15 Job still running ...
2023/05/01 15:26:45 Job still running ...
2023/05/01 15:27:15 Job still running ...
2023/05/01 15:27:45 Job still running ...
2023/05/01 15:28:15 Job still running ...
2023/05/01 15:28:45 Job still running ...
2023/05/01 15:29:15 Job still running ...
2023/05/01 15:29:45 Job still running ...
2023/05/01 15:30:16 Job still running ...
2023/05/01 15:30:46 Job still running ...
2023/05/01 15:31:16 Job still running ...
2023/05/01 15:31:46 Job still running ...
2023/05/01 15:32:16 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-01_08_23_44-9199968007446113455 failed
--- FAIL: TestXLang_Partition (551.45s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3281.733s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682951897447091940
--- FAIL: TestBigQueryIO_BasicWriteRead (9.48s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34483 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FWXfLNfJcy" is_bounded:BOUNDED windowing_strategy_id:"w0@FWXfLNfJcy"}} windowing_strategies:{key:"w0@FWXfLNfJcy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FWXfLNfJcy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FWXfLNfJcy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FWXfLNfJcy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682951897447091940\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FWXfLNfJcy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34483 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FWXfLNfJcy" is_bounded:BOUNDED windowing_strategy_id:"w0@FWXfLNfJcy"}} windowing_strategies:{key:"w0@FWXfLNfJcy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FWXfLNfJcy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FWXfLNfJcy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FWXfLNfJcy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682951897447091940\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FWXfLNfJcy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0006e4b00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0006e4b00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000afe00?, 0xc0000dd8b0?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x1?}, {0xc000045270, 0xf}, 0xc0006b9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000afd80?, 0xc0000dd8b0?}, {0xc0000506c0, 0x52}, {0x1?}, {0xc0006b9ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045270, 0xf}, {0xc0000506c0, 0x52}, {0xf24d60, 0xc000506590})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000cd380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000cd380, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 12.558s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.147s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.075s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.051s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-143716
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-143716
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:244cd75ada2608b645471939568803b376e2e18563ccb198b371afd9efde6cd0
Deleted: sha256:1b6ba272b8c0a05237fa87a3e80001557218fc4196a000b40adb703c3e357f30
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-143716
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:244cd75ada2608b645471939568803b376e2e18563ccb198b371afd9efde6cd0
Associated tags:
- 20230501-143716
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-143716
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-143716].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:244cd75ada2608b645471939568803b376e2e18563ccb198b371afd9efde6cd0].
$ rm -rf /tmp/tmp.amDCEqXt1Z
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501142546
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f3bd4eabfedf815e3b25f4b04b157498119a68f3b2dab67fe340b0d9442e335f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501142546]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f3bd4eabfedf815e3b25f4b04b157498119a68f3b2dab67fe340b0d9442e335f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501142546] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f3bd4eabfedf815e3b25f4b04b157498119a68f3b2dab67fe340b0d9442e335f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f3bd4eabfedf815e3b25f4b04b157498119a68f3b2dab67fe340b0d9442e335f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f3bd4eabfedf815e3b25f4b04b157498119a68f3b2dab67fe340b0d9442e335f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f3bd4eabfedf815e3b25f4b04b157498119a68f3b2dab67fe340b0d9442e335f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501142546
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:848e1f57704a8fe7056f60bde0e0f6c2940ae10d85d990b1c50d8c09444fcf21
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501142546]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:848e1f57704a8fe7056f60bde0e0f6c2940ae10d85d990b1c50d8c09444fcf21]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501142546] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:848e1f57704a8fe7056f60bde0e0f6c2940ae10d85d990b1c50d8c09444fcf21])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:848e1f57704a8fe7056f60bde0e0f6c2940ae10d85d990b1c50d8c09444fcf21
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:848e1f57704a8fe7056f60bde0e0f6c2940ae10d85d990b1c50d8c09444fcf21
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:848e1f57704a8fe7056f60bde0e0f6c2940ae10d85d990b1c50d8c09444fcf21].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2091206.
Stopping expansion service pid: 2091207.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/pmark7sxrzcx4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1592
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1592/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-083109",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-083109"
}
]
},
"name": "go-testxlang_partition-559",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/01 09:16:11 Submitted job: 2023-05-01_02_16_11-17810131348469187680
2023/05/01 09:16:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-01_02_16_11-17810131348469187680?project=apache-beam-testing
2023/05/01 09:16:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-05-01_02_16_11-17810131348469187680
2023/05/01 09:16:11 Job state: JOB_STATE_PENDING ...
2023/05/01 09:16:41 Job still running ...
2023/05/01 09:17:11 Job still running ...
2023/05/01 09:17:41 Job still running ...
2023/05/01 09:18:11 Job still running ...
2023/05/01 09:18:41 Job still running ...
2023/05/01 09:19:11 Job still running ...
2023/05/01 09:19:41 Job still running ...
2023/05/01 09:20:11 Job still running ...
2023/05/01 09:20:42 Job still running ...
2023/05/01 09:21:12 Job still running ...
2023/05/01 09:21:42 Job still running ...
2023/05/01 09:22:12 Job still running ...
2023/05/01 09:22:42 Job still running ...
2023/05/01 09:23:12 Job still running ...
2023/05/01 09:23:42 Job still running ...
2023/05/01 09:24:12 Job still running ...
2023/05/01 09:24:42 Job still running ...
2023/05/01 09:25:12 Job still running ...
2023/05/01 09:25:42 Job still running ...
2023/05/01 09:26:12 Job still running ...
2023/05/01 09:26:42 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-05-01_02_16_11-17810131348469187680 failed
--- FAIL: TestXLang_Partition (671.83s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3334.307s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682929901566021344
--- FAIL: TestBigQueryIO_BasicWriteRead (4.40s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38669 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@yyTVCPpfTn" is_bounded:BOUNDED windowing_strategy_id:"w0@yyTVCPpfTn"}} windowing_strategies:{key:"w0@yyTVCPpfTn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@yyTVCPpfTn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@yyTVCPpfTn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@yyTVCPpfTn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682929901566021344\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"yyTVCPpfTn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38669 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@yyTVCPpfTn" is_bounded:BOUNDED windowing_strategy_id:"w0@yyTVCPpfTn"}} windowing_strategies:{key:"w0@yyTVCPpfTn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@yyTVCPpfTn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@yyTVCPpfTn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@yyTVCPpfTn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682929901566021344\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"yyTVCPpfTn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0001ea400})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0001ea400})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e280?, 0xc000163ea0?}, {0x11c8c7d, 0x39}, {0xc0000f6180?, 0x10c85c0?, 0x1?}, {0xc00013bbc0, 0xf}, 0xc000561d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e200?, 0xc000163ea0?}, {0xc000050cc0, 0x52}, {0x1?}, {0xc000561ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00013bbc0, 0xf}, {0xc000050cc0, 0x52}, {0xf24d60, 0xc00046cf60})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000602b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000602b60, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.430s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-083109
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-083109
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f934b9d8896e15ed62ce6bdcf7de87cfcbfb0c1d1fbfd1dfb18177706f83ed96
Deleted: sha256:7d3e7d4f234a1634d484529bcdcc679d293931af22d3dd4263e60caab303a31f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-083109
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f934b9d8896e15ed62ce6bdcf7de87cfcbfb0c1d1fbfd1dfb18177706f83ed96
Associated tags:
- 20230501-083109
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-083109
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-083109].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f934b9d8896e15ed62ce6bdcf7de87cfcbfb0c1d1fbfd1dfb18177706f83ed96].
$ rm -rf /tmp/tmp.gl4lAb5ELy
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501082042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8af8bc91ecac86a15cf7f7cd0fffb07e0ad6f404564b86d6a8120bd4381697b8
Deleted: sha256:a3a7a6d5fd649e2e3499d8bda6725ac8d23200dc6fe0e7513fa350cd9e64ad4a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501082042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8af8bc91ecac86a15cf7f7cd0fffb07e0ad6f404564b86d6a8120bd4381697b8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501082042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8af8bc91ecac86a15cf7f7cd0fffb07e0ad6f404564b86d6a8120bd4381697b8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8af8bc91ecac86a15cf7f7cd0fffb07e0ad6f404564b86d6a8120bd4381697b8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8af8bc91ecac86a15cf7f7cd0fffb07e0ad6f404564b86d6a8120bd4381697b8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8af8bc91ecac86a15cf7f7cd0fffb07e0ad6f404564b86d6a8120bd4381697b8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501082042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4066503d9c0a3c651d3b7cbfcae3c844b6c3973196d596e9d1bce66771f3e66
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501082042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4066503d9c0a3c651d3b7cbfcae3c844b6c3973196d596e9d1bce66771f3e66]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501082042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4066503d9c0a3c651d3b7cbfcae3c844b6c3973196d596e9d1bce66771f3e66])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4066503d9c0a3c651d3b7cbfcae3c844b6c3973196d596e9d1bce66771f3e66
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4066503d9c0a3c651d3b7cbfcae3c844b6c3973196d596e9d1bce66771f3e66
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4066503d9c0a3c651d3b7cbfcae3c844b6c3973196d596e9d1bce66771f3e66].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3284081.
Stopping expansion service pid: 3284082.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 59s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/xcfjwg5v7ucgg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1591
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1591/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501022159",
"environmentId": "aTPCfxkUdibeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-023349"
}
]
},
"name": "go-testxlang_partition-537",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/05/01 03:17:44 Submitted job: 2023-04-30_20_17_44-13517183660894037774
2023/05/01 03:17:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-30_20_17_44-13517183660894037774?project=apache-beam-testing
2023/05/01 03:17:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-30_20_17_44-13517183660894037774
2023/05/01 03:17:44 Job state: JOB_STATE_PENDING ...
2023/05/01 03:18:14 Job still running ...
2023/05/01 03:18:44 Job still running ...
2023/05/01 03:19:15 Job still running ...
2023/05/01 03:19:45 Job still running ...
2023/05/01 03:20:15 Job still running ...
2023/05/01 03:20:45 Job still running ...
2023/05/01 03:21:15 Job still running ...
2023/05/01 03:21:45 Job still running ...
2023/05/01 03:22:15 Job still running ...
2023/05/01 03:22:45 Job still running ...
2023/05/01 03:23:15 Job still running ...
2023/05/01 03:23:45 Job still running ...
2023/05/01 03:24:15 Job still running ...
2023/05/01 03:24:45 Job still running ...
2023/05/01 03:25:15 Job still running ...
2023/05/01 03:25:45 Job still running ...
2023/05/01 03:26:15 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-30_20_17_44-13517183660894037774 failed
--- FAIL: TestXLang_Partition (550.31s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3145.858s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682908463171190869
--- FAIL: TestBigQueryIO_BasicWriteRead (4.55s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42733 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@inVUWolNZm" is_bounded:BOUNDED windowing_strategy_id:"w0@inVUWolNZm"}} windowing_strategies:{key:"w0@inVUWolNZm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@inVUWolNZm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@inVUWolNZm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@inVUWolNZm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682908463171190869\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"inVUWolNZm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42733 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@inVUWolNZm" is_bounded:BOUNDED windowing_strategy_id:"w0@inVUWolNZm"}} windowing_strategies:{key:"w0@inVUWolNZm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@inVUWolNZm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@inVUWolNZm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@inVUWolNZm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682908463171190869\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"inVUWolNZm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc000696440})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc000696440})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006800c0?, 0xc0000c4050?}, {0x11c8c7d, 0x39}, {0xc0005140c0?, 0x10c85c0?, 0x41bc91?}, {0xc000489f80, 0xf}, 0xc0002abd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000680040?, 0xc0000c4050?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc0002abea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010ec00, 0x52}, {0xf24d60, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00034f520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00034f520, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.576s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-023349
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-023349
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:338038bb0ee91c923cc488c3a6967faab06b26be4262160c56925efd3471c692
Deleted: sha256:65a0406d6b22dd8708f1a989be4900c00af80c5324c907c1bd725b32bc07c597
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-023349
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:338038bb0ee91c923cc488c3a6967faab06b26be4262160c56925efd3471c692
Associated tags:
- 20230501-023349
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-023349
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230501-023349].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:338038bb0ee91c923cc488c3a6967faab06b26be4262160c56925efd3471c692].
$ rm -rf /tmp/tmp.9cHx8COkTJ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501022159
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:33d885aabfa85955c02c8f4c12ea5a899c8d146c51011b03a8ba84199c7527a4
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501022159]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:33d885aabfa85955c02c8f4c12ea5a899c8d146c51011b03a8ba84199c7527a4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230501022159] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:33d885aabfa85955c02c8f4c12ea5a899c8d146c51011b03a8ba84199c7527a4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:33d885aabfa85955c02c8f4c12ea5a899c8d146c51011b03a8ba84199c7527a4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:33d885aabfa85955c02c8f4c12ea5a899c8d146c51011b03a8ba84199c7527a4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:33d885aabfa85955c02c8f4c12ea5a899c8d146c51011b03a8ba84199c7527a4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501022159
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0d63e7220bc6ca915464a09beb92ed06b962e2ff2050ff3b52bf34c4990f0d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501022159]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0d63e7220bc6ca915464a09beb92ed06b962e2ff2050ff3b52bf34c4990f0d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230501022159] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0d63e7220bc6ca915464a09beb92ed06b962e2ff2050ff3b52bf34c4990f0d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0d63e7220bc6ca915464a09beb92ed06b962e2ff2050ff3b52bf34c4990f0d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0d63e7220bc6ca915464a09beb92ed06b962e2ff2050ff3b52bf34c4990f0d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0d63e7220bc6ca915464a09beb92ed06b962e2ff2050ff3b52bf34c4990f0d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3103812.
Stopping expansion service pid: 3103813.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 13s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ohzuzodz5mnhi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1590
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1590/display/redirect>
Changes:
------------------------------------------
[...truncated 1.07 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430202048",
"environmentId": "aWduvTfzvRbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-203313"
}
]
},
"name": "go-testxlang_partition-444",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/30 21:17:18 Submitted job: 2023-04-30_14_17_17-11390226632811225661
2023/04/30 21:17:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-30_14_17_17-11390226632811225661?project=apache-beam-testing
2023/04/30 21:17:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-30_14_17_17-11390226632811225661
2023/04/30 21:17:18 Job state: JOB_STATE_PENDING ...
2023/04/30 21:17:48 Job still running ...
2023/04/30 21:18:18 Job still running ...
2023/04/30 21:18:48 Job still running ...
2023/04/30 21:19:18 Job still running ...
2023/04/30 21:19:48 Job still running ...
2023/04/30 21:20:18 Job still running ...
2023/04/30 21:20:48 Job still running ...
2023/04/30 21:21:18 Job still running ...
2023/04/30 21:21:48 Job still running ...
2023/04/30 21:22:18 Job still running ...
2023/04/30 21:22:48 Job still running ...
2023/04/30 21:23:18 Job still running ...
2023/04/30 21:23:48 Job still running ...
2023/04/30 21:24:18 Job still running ...
2023/04/30 21:24:49 Job still running ...
2023/04/30 21:25:19 Job still running ...
2023/04/30 21:25:49 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-30_14_17_17-11390226632811225661 failed
--- FAIL: TestXLang_Partition (550.56s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3150.563s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682886831840282064
--- FAIL: TestBigQueryIO_BasicWriteRead (4.70s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36917 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DheDjTfTeg" is_bounded:BOUNDED windowing_strategy_id:"w0@DheDjTfTeg"}} windowing_strategies:{key:"w0@DheDjTfTeg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DheDjTfTeg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DheDjTfTeg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DheDjTfTeg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682886831840282064\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DheDjTfTeg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36917 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DheDjTfTeg" is_bounded:BOUNDED windowing_strategy_id:"w0@DheDjTfTeg"}} windowing_strategies:{key:"w0@DheDjTfTeg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DheDjTfTeg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DheDjTfTeg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DheDjTfTeg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682886831840282064\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DheDjTfTeg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0003e63c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0003e63c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00051afa0?, 0xc000136280?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x1?}, {0xc000489f80, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00051af20?, 0xc000136280?}, {0xc00010ec00, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010ec00, 0x52}, {0xf24d60, 0xc000045350})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642ea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642ea0, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.722s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-203313
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-203313
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e8f732a2475357091ca16060c97b3ad12e31902c390ae2e85bf12997b25e7176
Deleted: sha256:f8e43ecbd312d14286c4cc3096016bb5fe2cfe71d371be4ed7180d7290a32b9d
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-203313
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e8f732a2475357091ca16060c97b3ad12e31902c390ae2e85bf12997b25e7176
Associated tags:
- 20230430-203313
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-203313
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-203313].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e8f732a2475357091ca16060c97b3ad12e31902c390ae2e85bf12997b25e7176].
$ rm -rf /tmp/tmp.pNFKOQO68E
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430202048
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bc2036f0d53780834aca532b790b24a08948618a1872681713c5ed962d07f46
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430202048]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bc2036f0d53780834aca532b790b24a08948618a1872681713c5ed962d07f46]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430202048] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bc2036f0d53780834aca532b790b24a08948618a1872681713c5ed962d07f46])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bc2036f0d53780834aca532b790b24a08948618a1872681713c5ed962d07f46
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bc2036f0d53780834aca532b790b24a08948618a1872681713c5ed962d07f46
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bc2036f0d53780834aca532b790b24a08948618a1872681713c5ed962d07f46].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430202048
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a6ffbedb4ce8249dc6dbd9ef58e95762c77fc3daa57f3420feed7ae0cbbe93e2
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430202048]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a6ffbedb4ce8249dc6dbd9ef58e95762c77fc3daa57f3420feed7ae0cbbe93e2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430202048] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a6ffbedb4ce8249dc6dbd9ef58e95762c77fc3daa57f3420feed7ae0cbbe93e2])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a6ffbedb4ce8249dc6dbd9ef58e95762c77fc3daa57f3420feed7ae0cbbe93e2
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a6ffbedb4ce8249dc6dbd9ef58e95762c77fc3daa57f3420feed7ae0cbbe93e2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a6ffbedb4ce8249dc6dbd9ef58e95762c77fc3daa57f3420feed7ae0cbbe93e2].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2977174.
Stopping expansion service pid: 2977175.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 59s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/lqnipd53drpys
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1589
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1589/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430142035",
"environmentId": "aHifbflgDobeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-143129"
}
]
},
"name": "go-testxlang_partition-903",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/30 15:17:02 Submitted job: 2023-04-30_08_17_02-4011539688514373985
2023/04/30 15:17:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-30_08_17_02-4011539688514373985?project=apache-beam-testing
2023/04/30 15:17:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-30_08_17_02-4011539688514373985
2023/04/30 15:17:02 Job state: JOB_STATE_PENDING ...
2023/04/30 15:17:32 Job still running ...
2023/04/30 15:18:02 Job still running ...
2023/04/30 15:18:32 Job still running ...
2023/04/30 15:19:02 Job still running ...
2023/04/30 15:19:33 Job still running ...
2023/04/30 15:20:03 Job still running ...
2023/04/30 15:20:33 Job still running ...
2023/04/30 15:21:03 Job still running ...
2023/04/30 15:21:33 Job still running ...
2023/04/30 15:22:03 Job still running ...
2023/04/30 15:22:33 Job still running ...
2023/04/30 15:23:03 Job still running ...
2023/04/30 15:23:34 Job still running ...
2023/04/30 15:24:04 Job still running ...
2023/04/30 15:24:34 Job still running ...
2023/04/30 15:25:04 Job still running ...
2023/04/30 15:25:34 Job still running ...
2023/04/30 15:26:04 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-30_08_17_02-4011539688514373985 failed
--- FAIL: TestXLang_Partition (581.42s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3272.295s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682865125260982666
--- FAIL: TestBigQueryIO_BasicWriteRead (6.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43689 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IDttMsQHTE" is_bounded:BOUNDED windowing_strategy_id:"w0@IDttMsQHTE"}} windowing_strategies:{key:"w0@IDttMsQHTE" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IDttMsQHTE" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IDttMsQHTE" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IDttMsQHTE" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682865125260982666\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IDttMsQHTE"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43689 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IDttMsQHTE" is_bounded:BOUNDED windowing_strategy_id:"w0@IDttMsQHTE"}} windowing_strategies:{key:"w0@IDttMsQHTE" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IDttMsQHTE" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IDttMsQHTE" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IDttMsQHTE" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682865125260982666\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IDttMsQHTE"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc00079e700})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc00079e700})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010ef20?, 0xc000169f90?}, {0x11c8c7d, 0x39}, {0xc0000f6180?, 0x10c85c0?, 0x1?}, {0xc00013fde0, 0xf}, 0xc000579d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010eea0?, 0xc000169f90?}, {0xc000050d20, 0x52}, {0x1?}, {0xc000579ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00013fde0, 0xf}, {0xc000050d20, 0x52}, {0xf24d60, 0xc00046d220})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000702b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000702b60, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.357s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.078s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0e21343be94e0fee4cb6f70ace5893908fd2881fe89468f896f89fbd381db216
Associated tags:
- 20230430-143129
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-143129
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-143129].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0e21343be94e0fee4cb6f70ace5893908fd2881fe89468f896f89fbd381db216].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430142035]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:40a5ee74d8542b6e05df34a1920fac9b55be493d601f764be6bb52603c0d69a4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430142035] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:40a5ee74d8542b6e05df34a1920fac9b55be493d601f764be6bb52603c0d69a4])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:40a5ee74d8542b6e05df34a1920fac9b55be493d601f764be6bb52603c0d69a4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:40a5ee74d8542b6e05df34a1920fac9b55be493d601f764be6bb52603c0d69a4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430142035]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d438ef5ed5bef9c47f4a28ada5a0b74a9c53214ac48705ba3a98c158dd6fa6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430142035] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d438ef5ed5bef9c47f4a28ada5a0b74a9c53214ac48705ba3a98c158dd6fa6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d438ef5ed5bef9c47f4a28ada5a0b74a9c53214ac48705ba3a98c158dd6fa6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25d438ef5ed5bef9c47f4a28ada5a0b74a9c53214ac48705ba3a98c158dd6fa6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 27s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/7bgnik2eo6wbu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1588
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1588/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430082050",
"environmentId": "wEjcUoUSNpbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-083128"
}
]
},
"name": "go-testxlang_partition-20",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/30 09:15:54 Submitted job: 2023-04-30_02_15_54-4135229179449533641
2023/04/30 09:15:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-30_02_15_54-4135229179449533641?project=apache-beam-testing
2023/04/30 09:15:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-30_02_15_54-4135229179449533641
2023/04/30 09:15:54 Job state: JOB_STATE_PENDING ...
2023/04/30 09:16:24 Job still running ...
2023/04/30 09:16:54 Job still running ...
2023/04/30 09:17:24 Job still running ...
2023/04/30 09:17:54 Job still running ...
2023/04/30 09:18:25 Job still running ...
2023/04/30 09:18:55 Job still running ...
2023/04/30 09:19:25 Job still running ...
2023/04/30 09:19:55 Job still running ...
2023/04/30 09:20:25 Job still running ...
2023/04/30 09:20:55 Job still running ...
2023/04/30 09:21:25 Job still running ...
2023/04/30 09:21:55 Job still running ...
2023/04/30 09:22:25 Job still running ...
2023/04/30 09:22:55 Job still running ...
2023/04/30 09:23:25 Job still running ...
2023/04/30 09:23:55 Job still running ...
2023/04/30 09:24:25 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-30_02_15_54-4135229179449533641 failed
--- FAIL: TestXLang_Partition (550.49s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3174.458s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682843524392428717
--- FAIL: TestBigQueryIO_BasicWriteRead (4.49s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38599 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XonHvMlVXJ" is_bounded:BOUNDED windowing_strategy_id:"w0@XonHvMlVXJ"}} windowing_strategies:{key:"w0@XonHvMlVXJ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XonHvMlVXJ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XonHvMlVXJ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XonHvMlVXJ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682843524392428717\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XonHvMlVXJ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38599 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XonHvMlVXJ" is_bounded:BOUNDED windowing_strategy_id:"w0@XonHvMlVXJ"}} windowing_strategies:{key:"w0@XonHvMlVXJ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XonHvMlVXJ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XonHvMlVXJ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XonHvMlVXJ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682843524392428717\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XonHvMlVXJ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 24 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0004d6e80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0004d6e80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e0c0?, 0xc000520000?}, {0x11c8c7d, 0x39}, {0xc00052a0c0?, 0x10c85c0?, 0x41bc91?}, {0xc00046de10, 0xf}, 0xc0001a5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc000520000?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc0001a5ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050ea0, 0x52}, {0xf24d60, 0xc0000440b8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d9520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d9520, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.519s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-083128
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-083128
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b0957d1a7644f8dc66bc78f137eda0fc245be85284ff0f2dd28893ef61752630
Deleted: sha256:2fb5f3314e1fa10fc5179f156f773bc7a8d7e2fbe8f651a1cc16f8ed4c589d2a
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-083128
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b0957d1a7644f8dc66bc78f137eda0fc245be85284ff0f2dd28893ef61752630
Associated tags:
- 20230430-083128
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-083128
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-083128].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b0957d1a7644f8dc66bc78f137eda0fc245be85284ff0f2dd28893ef61752630].
$ rm -rf /tmp/tmp.k1uJNoiDlB
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430082050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:38ea26e4a1429d0fd4a8dab68b83cb1f2666e48b245f27db92d4156be65fc154
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430082050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:38ea26e4a1429d0fd4a8dab68b83cb1f2666e48b245f27db92d4156be65fc154]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430082050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:38ea26e4a1429d0fd4a8dab68b83cb1f2666e48b245f27db92d4156be65fc154])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:38ea26e4a1429d0fd4a8dab68b83cb1f2666e48b245f27db92d4156be65fc154
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:38ea26e4a1429d0fd4a8dab68b83cb1f2666e48b245f27db92d4156be65fc154
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:38ea26e4a1429d0fd4a8dab68b83cb1f2666e48b245f27db92d4156be65fc154].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430082050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:281afe684581b4c44f1e4f16115c2efe82fffc251737108d374b7e2af0ad905b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430082050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:281afe684581b4c44f1e4f16115c2efe82fffc251737108d374b7e2af0ad905b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430082050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:281afe684581b4c44f1e4f16115c2efe82fffc251737108d374b7e2af0ad905b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:281afe684581b4c44f1e4f16115c2efe82fffc251737108d374b7e2af0ad905b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:281afe684581b4c44f1e4f16115c2efe82fffc251737108d374b7e2af0ad905b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:281afe684581b4c44f1e4f16115c2efe82fffc251737108d374b7e2af0ad905b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2773770.
Stopping expansion service pid: 2773771.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 36s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/tj2xc7teyujro
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1587
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1587/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430022042",
"environmentId": "ZbaXZulgbsbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-023129"
}
]
},
"name": "go-testxlang_partition-784",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/30 03:16:27 Submitted job: 2023-04-29_20_16_27-11266700781675476701
2023/04/30 03:16:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-29_20_16_27-11266700781675476701?project=apache-beam-testing
2023/04/30 03:16:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-29_20_16_27-11266700781675476701
2023/04/30 03:16:27 Job state: JOB_STATE_PENDING ...
2023/04/30 03:16:57 Job still running ...
2023/04/30 03:17:28 Job still running ...
2023/04/30 03:17:58 Job still running ...
2023/04/30 03:18:28 Job still running ...
2023/04/30 03:18:58 Job still running ...
2023/04/30 03:19:28 Job still running ...
2023/04/30 03:19:58 Job still running ...
2023/04/30 03:20:28 Job still running ...
2023/04/30 03:20:58 Job still running ...
2023/04/30 03:21:28 Job still running ...
2023/04/30 03:21:58 Job still running ...
2023/04/30 03:22:28 Job still running ...
2023/04/30 03:22:58 Job still running ...
2023/04/30 03:23:28 Job still running ...
2023/04/30 03:23:58 Job still running ...
2023/04/30 03:24:28 Job still running ...
2023/04/30 03:24:58 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-29_20_16_27-11266700781675476701 failed
--- FAIL: TestXLang_Partition (549.84s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3208.777s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682821923176283464
--- FAIL: TestBigQueryIO_BasicWriteRead (4.56s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46879 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bdoONIQTjH" is_bounded:BOUNDED windowing_strategy_id:"w0@bdoONIQTjH"}} windowing_strategies:{key:"w0@bdoONIQTjH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bdoONIQTjH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bdoONIQTjH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bdoONIQTjH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682821923176283464\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bdoONIQTjH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46879 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bdoONIQTjH" is_bounded:BOUNDED windowing_strategy_id:"w0@bdoONIQTjH"}} windowing_strategies:{key:"w0@bdoONIQTjH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bdoONIQTjH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bdoONIQTjH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bdoONIQTjH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682821923176283464\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bdoONIQTjH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 15 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0006ea900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0006ea900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1e0?, 0xc0000c4280?}, {0x11c8c7d, 0x39}, {0xc0001360c0?, 0x10c85c0?, 0x41bc91?}, {0xc00046de10, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc0000c4280?}, {0xc000050ea0, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050ea0, 0x52}, {0xf24d60, 0xc0000440b8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2d00, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.582s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cc9a68e9fd9cfb45dd1d00aa4dd1d9e247f49a393a8fc0dadc5fa77ce68775a4
Associated tags:
- 20230430-023129
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-023129
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230430-023129].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cc9a68e9fd9cfb45dd1d00aa4dd1d9e247f49a393a8fc0dadc5fa77ce68775a4].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c8520a92f729dcfdc3c87c87de4c2559111a25f73934427a385274a1a3f9b48]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230430022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c8520a92f729dcfdc3c87c87de4c2559111a25f73934427a385274a1a3f9b48])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c8520a92f729dcfdc3c87c87de4c2559111a25f73934427a385274a1a3f9b48
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c8520a92f729dcfdc3c87c87de4c2559111a25f73934427a385274a1a3f9b48].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:39dcb9c1a1f475371743f856890a4a6b565775955ba3316323df414e106138c6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230430022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:39dcb9c1a1f475371743f856890a4a6b565775955ba3316323df414e106138c6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:39dcb9c1a1f475371743f856890a4a6b565775955ba3316323df414e106138c6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:39dcb9c1a1f475371743f856890a4a6b565775955ba3316323df414e106138c6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 14s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/y6pgcppk3ltxo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1586
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1586/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429202033",
"environmentId": "rrZyHKueiIbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-203156"
}
]
},
"name": "go-testxlang_partition-12",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/29 21:17:00 Submitted job: 2023-04-29_14_16_59-1887491728207799887
2023/04/29 21:17:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-29_14_16_59-1887491728207799887?project=apache-beam-testing
2023/04/29 21:17:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-29_14_16_59-1887491728207799887
2023/04/29 21:17:00 Job state: JOB_STATE_PENDING ...
2023/04/29 21:17:30 Job still running ...
2023/04/29 21:18:00 Job still running ...
2023/04/29 21:18:30 Job still running ...
2023/04/29 21:19:00 Job still running ...
2023/04/29 21:19:30 Job still running ...
2023/04/29 21:20:00 Job still running ...
2023/04/29 21:20:30 Job still running ...
2023/04/29 21:21:00 Job still running ...
2023/04/29 21:21:30 Job still running ...
2023/04/29 21:22:00 Job still running ...
2023/04/29 21:22:30 Job still running ...
2023/04/29 21:23:00 Job still running ...
2023/04/29 21:23:30 Job still running ...
2023/04/29 21:24:01 Job still running ...
2023/04/29 21:24:31 Job still running ...
2023/04/29 21:25:01 Job still running ...
2023/04/29 21:25:31 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-29_14_16_59-1887491728207799887 failed
--- FAIL: TestXLang_Partition (550.57s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3209.608s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682800354955244691
--- FAIL: TestBigQueryIO_BasicWriteRead (4.72s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40463 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RyoJMlnflk" is_bounded:BOUNDED windowing_strategy_id:"w0@RyoJMlnflk"}} windowing_strategies:{key:"w0@RyoJMlnflk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RyoJMlnflk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RyoJMlnflk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RyoJMlnflk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682800354955244691\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RyoJMlnflk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40463 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RyoJMlnflk" is_bounded:BOUNDED windowing_strategy_id:"w0@RyoJMlnflk"}} windowing_strategies:{key:"w0@RyoJMlnflk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RyoJMlnflk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RyoJMlnflk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RyoJMlnflk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682800354955244691\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RyoJMlnflk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc000324740})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc000324740})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006a2fe0?, 0xc0001362d0?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x1?}, {0xc000045f60, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006a2f60?, 0xc0001362d0?}, {0xc000050900, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f60, 0xf}, {0xc000050900, 0x52}, {0xf24d60, 0xc000489350})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000643040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000643040, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.753s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-203156
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-203156
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ead68b03eddf07369de584ebdd58b2c82aa25bfe90d587954880db73c4ba2d88
Deleted: sha256:997ad1b154aeae2d02c7acaec1ec88f6a58f9a62b9b06aad6b57e681c31a74da
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-203156
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ead68b03eddf07369de584ebdd58b2c82aa25bfe90d587954880db73c4ba2d88
Associated tags:
- 20230429-203156
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-203156
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-203156].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ead68b03eddf07369de584ebdd58b2c82aa25bfe90d587954880db73c4ba2d88].
$ rm -rf /tmp/tmp.LyqO2sl9KC
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429202033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73eb8d08ad495e0e9c0f3d541183523b9651d25f8656c28bbade5167d5c37ba7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429202033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73eb8d08ad495e0e9c0f3d541183523b9651d25f8656c28bbade5167d5c37ba7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429202033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73eb8d08ad495e0e9c0f3d541183523b9651d25f8656c28bbade5167d5c37ba7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73eb8d08ad495e0e9c0f3d541183523b9651d25f8656c28bbade5167d5c37ba7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73eb8d08ad495e0e9c0f3d541183523b9651d25f8656c28bbade5167d5c37ba7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73eb8d08ad495e0e9c0f3d541183523b9651d25f8656c28bbade5167d5c37ba7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429202033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee6fb407e0b108a35f5ce6a1091aec78b5daa1cb62cade81fe7170e5bfc9c5aa
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429202033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee6fb407e0b108a35f5ce6a1091aec78b5daa1cb62cade81fe7170e5bfc9c5aa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429202033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee6fb407e0b108a35f5ce6a1091aec78b5daa1cb62cade81fe7170e5bfc9c5aa])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee6fb407e0b108a35f5ce6a1091aec78b5daa1cb62cade81fe7170e5bfc9c5aa
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee6fb407e0b108a35f5ce6a1091aec78b5daa1cb62cade81fe7170e5bfc9c5aa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee6fb407e0b108a35f5ce6a1091aec78b5daa1cb62cade81fe7170e5bfc9c5aa].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2557951.
Stopping expansion service pid: 2557952.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 58s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/d774luvy435pm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1585
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1585/display/redirect>
Changes:
------------------------------------------
[...truncated 655.73 KB...]
Publishing build scan...
https://gradle.com/s/3ctjqjvmme26k
$ docker images
$ grep 20230429-143158
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk 20230429-143158 30bae07749b7 1 second ago 152MB
$ gcloud docker -- push us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk]
e300b5c97163: Preparing
bde5792a1fe6: Preparing
7e424bfe6e66: Preparing
a7abe1108270: Preparing
f880fef9d159: Preparing
2374a2ca714a: Preparing
ae56c0c5405b: Preparing
2374a2ca714a: Waiting
ae56c0c5405b: Waiting
7e424bfe6e66: Pushed
e300b5c97163: Pushed
a7abe1108270: Pushed
bde5792a1fe6: Pushed
ae56c0c5405b: Layer already exists
2374a2ca714a: Pushed
f880fef9d159: Pushed
20230429-143158: digest: sha256:985fc10813bf292f489cd5d754c758679db5829f4f05599158c663eb7c53123c size: 1783
$ OVERRIDE=--sdk_harness_container_image_override=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429142043
$ cd sdks/go
>>> RUNNING dataflow integration tests with pipeline options: -p 3 -timeout 3h --runner=dataflow --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test10492 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test10492 --endpoint= --sdk_harness_container_image_override=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429142043 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.48.0-SNAPSHOT.jar> --expansion_jar=io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.48.0-SNAPSHOT.jar> --expansion_jar=schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.48.0-SNAPSHOT.jar> --expansion_jar=debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.48.0-SNAPSHOT.jar> --expansion_jar=gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.48.0-SNAPSHOT.jar> --bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp --expansion_addr=test:localhost:38811
$
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.20.2
go1.20.2: already downloaded in /home/jenkins/sdk/go1.20.2
/home/jenkins/go/bin/go1.20.2 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 3 -timeout 3h --runner=dataflow --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158 --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test10492 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test10492 --endpoint= --sdk_harness_container_image_override=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429142043 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.48.0-SNAPSHOT.jar> --expansion_jar=io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.48.0-SNAPSHOT.jar> --expansion_jar=schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.48.0-SNAPSHOT.jar> --expansion_jar=debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.48.0-SNAPSHOT.jar> --expansion_jar=gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.48.0-SNAPSHOT.jar> --bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp --expansion_addr=test:localhost:38811
=== RUN TestAutomatedExpansionService
--- PASS: TestAutomatedExpansionService (2.86s)
=== RUN TestXLang_Prefix
2023/04/29 14:32:36 Unsupported artifact type beam:artifact:type:deferred:v1
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 4.410s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682778755331431777
--- FAIL: TestBigQueryIO_BasicWriteRead (4.48s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43191 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tSwXMAQMyQ" is_bounded:BOUNDED windowing_strategy_id:"w0@tSwXMAQMyQ"}} windowing_strategies:{key:"w0@tSwXMAQMyQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tSwXMAQMyQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tSwXMAQMyQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tSwXMAQMyQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682778755331431777\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tSwXMAQMyQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43191 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tSwXMAQMyQ" is_bounded:BOUNDED windowing_strategy_id:"w0@tSwXMAQMyQ"}} windowing_strategies:{key:"w0@tSwXMAQMyQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tSwXMAQMyQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tSwXMAQMyQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tSwXMAQMyQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682778755331431777\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tSwXMAQMyQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0002827c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0002827c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae820?, 0xc00057e3c0?}, {0x11c8c7d, 0x39}, {0xc0000f6180?, 0x10c85c0?, 0x1?}, {0xc00046def0, 0xf}, 0xc000127d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae340?, 0xc00057e3c0?}, {0xc000050e40, 0x52}, {0x1?}, {0xc000127ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046def0, 0xf}, {0xc000050e40, 0x52}, {0xf24d60, 0xc000045af0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000601520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000601520, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.512s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:985fc10813bf292f489cd5d754c758679db5829f4f05599158c663eb7c53123c
Deleted: sha256:30bae07749b736c2aebc02430b41e20eefe9acc4ac56f79cc2cdf7ba7acb25f5
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:985fc10813bf292f489cd5d754c758679db5829f4f05599158c663eb7c53123c
Associated tags:
- 20230429-143158
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-143158].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:985fc10813bf292f489cd5d754c758679db5829f4f05599158c663eb7c53123c].
$ rm -rf /tmp/tmp.HI2gIWIZ1b
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429142043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cae4aeabff432cb51076bf64a304d07b7015a78529829d250aea20d8e0440c7b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429142043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cae4aeabff432cb51076bf64a304d07b7015a78529829d250aea20d8e0440c7b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429142043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cae4aeabff432cb51076bf64a304d07b7015a78529829d250aea20d8e0440c7b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cae4aeabff432cb51076bf64a304d07b7015a78529829d250aea20d8e0440c7b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cae4aeabff432cb51076bf64a304d07b7015a78529829d250aea20d8e0440c7b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cae4aeabff432cb51076bf64a304d07b7015a78529829d250aea20d8e0440c7b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429142043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3b78fa493f93ddd76de2a8189517b83e991397a7fb5a2d91aabee6e2a56c2abc
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429142043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3b78fa493f93ddd76de2a8189517b83e991397a7fb5a2d91aabee6e2a56c2abc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429142043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3b78fa493f93ddd76de2a8189517b83e991397a7fb5a2d91aabee6e2a56c2abc])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3b78fa493f93ddd76de2a8189517b83e991397a7fb5a2d91aabee6e2a56c2abc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3b78fa493f93ddd76de2a8189517b83e991397a7fb5a2d91aabee6e2a56c2abc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3b78fa493f93ddd76de2a8189517b83e991397a7fb5a2d91aabee6e2a56c2abc].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2345259.
Stopping expansion service pid: 2345260.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 27s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/hkr3ctvainlpu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1584
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1584/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429082043",
"environmentId": "XMJVDofFRmbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-083213",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-083213"
}
]
},
"name": "go-testxlang_partition-75",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/29 09:16:09 Submitted job: 2023-04-29_02_16_08-1133395592243348470
2023/04/29 09:16:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-29_02_16_08-1133395592243348470?project=apache-beam-testing
2023/04/29 09:16:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-29_02_16_08-1133395592243348470
2023/04/29 09:16:09 Job state: JOB_STATE_PENDING ...
2023/04/29 09:16:39 Job still running ...
2023/04/29 09:17:09 Job still running ...
2023/04/29 09:17:39 Job still running ...
2023/04/29 09:18:09 Job still running ...
2023/04/29 09:18:39 Job still running ...
2023/04/29 09:19:09 Job still running ...
2023/04/29 09:19:39 Job still running ...
2023/04/29 09:20:09 Job still running ...
2023/04/29 09:20:39 Job still running ...
2023/04/29 09:21:09 Job still running ...
2023/04/29 09:21:39 Job still running ...
2023/04/29 09:22:09 Job still running ...
2023/04/29 09:22:39 Job still running ...
2023/04/29 09:23:09 Job still running ...
2023/04/29 09:23:39 Job still running ...
2023/04/29 09:24:09 Job still running ...
2023/04/29 09:24:39 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-29_02_16_08-1133395592243348470 failed
--- FAIL: TestXLang_Partition (550.20s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3143.925s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682757169290441983
--- FAIL: TestBigQueryIO_BasicWriteRead (4.76s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46341 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@koxlElSLbP" is_bounded:BOUNDED windowing_strategy_id:"w0@koxlElSLbP"}} windowing_strategies:{key:"w0@koxlElSLbP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@koxlElSLbP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@koxlElSLbP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@koxlElSLbP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682757169290441983\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"koxlElSLbP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46341 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@koxlElSLbP" is_bounded:BOUNDED windowing_strategy_id:"w0@koxlElSLbP"}} windowing_strategies:{key:"w0@koxlElSLbP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@koxlElSLbP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@koxlElSLbP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@koxlElSLbP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682757169290441983\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"koxlElSLbP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc00031e640})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc00031e640})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00065c0a0?, 0xc000662000?}, {0x11c8c7d, 0x39}, {0xc0000f6180?, 0x10c85c0?, 0x41bc91?}, {0xc00046dee0, 0xf}, 0xc0001a5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00065c020?, 0xc000662000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc0001a5ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dee0, 0xf}, {0xc000050e40, 0x52}, {0xf24d60, 0xc00065e008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000581380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000581380, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.787s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6bbe0a7b1db234edce4d9f912fa3a76573304dd86cb282cdd5c8be7cd815afa6
Associated tags:
- 20230429-083213
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-083213
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-083213].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6bbe0a7b1db234edce4d9f912fa3a76573304dd86cb282cdd5c8be7cd815afa6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429082043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3a443c87d34ad7f1af95d2cafc9aefe789c34be8af7ba92643a2fce5b496e478]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429082043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3a443c87d34ad7f1af95d2cafc9aefe789c34be8af7ba92643a2fce5b496e478])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3a443c87d34ad7f1af95d2cafc9aefe789c34be8af7ba92643a2fce5b496e478
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3a443c87d34ad7f1af95d2cafc9aefe789c34be8af7ba92643a2fce5b496e478].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429082043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1097a675a981bd60151a125bdc105d0072835d5222cd89d2e05201f13e834be2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429082043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1097a675a981bd60151a125bdc105d0072835d5222cd89d2e05201f13e834be2])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1097a675a981bd60151a125bdc105d0072835d5222cd89d2e05201f13e834be2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1097a675a981bd60151a125bdc105d0072835d5222cd89d2e05201f13e834be2].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 54s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/vgin7uvxjxcjy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1583
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1583/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429022034",
"environmentId": "kalVYbFkjMbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-023139",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-023139"
}
]
},
"name": "go-testxlang_partition-223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/29 03:19:18 Submitted job: 2023-04-28_20_19_18-13793557217991959480
2023/04/29 03:19:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-28_20_19_18-13793557217991959480?project=apache-beam-testing
2023/04/29 03:19:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-28_20_19_18-13793557217991959480
2023/04/29 03:19:18 Job state: JOB_STATE_PENDING ...
2023/04/29 03:19:48 Job still running ...
2023/04/29 03:20:18 Job still running ...
2023/04/29 03:20:48 Job still running ...
2023/04/29 03:21:18 Job still running ...
2023/04/29 03:21:48 Job still running ...
2023/04/29 03:22:18 Job still running ...
2023/04/29 03:22:48 Job still running ...
2023/04/29 03:23:19 Job still running ...
2023/04/29 03:23:49 Job still running ...
2023/04/29 03:24:19 Job still running ...
2023/04/29 03:24:49 Job still running ...
2023/04/29 03:25:19 Job still running ...
2023/04/29 03:25:49 Job still running ...
2023/04/29 03:26:19 Job still running ...
2023/04/29 03:26:49 Job still running ...
2023/04/29 03:27:19 Job still running ...
2023/04/29 03:27:49 Job still running ...
2023/04/29 03:28:19 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-28_20_19_18-13793557217991959480 failed
--- FAIL: TestXLang_Partition (581.42s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3399.095s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682735533635364171
--- FAIL: TestBigQueryIO_BasicWriteRead (4.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41547 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IJlGxSKgxQ" is_bounded:BOUNDED windowing_strategy_id:"w0@IJlGxSKgxQ"}} windowing_strategies:{key:"w0@IJlGxSKgxQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IJlGxSKgxQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IJlGxSKgxQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IJlGxSKgxQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682735533635364171\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IJlGxSKgxQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41547 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IJlGxSKgxQ" is_bounded:BOUNDED windowing_strategy_id:"w0@IJlGxSKgxQ"}} windowing_strategies:{key:"w0@IJlGxSKgxQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IJlGxSKgxQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IJlGxSKgxQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IJlGxSKgxQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682735533635364171\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IJlGxSKgxQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 14 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0005b6500})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0005b6500})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae9a0?, 0xc0007283c0?}, {0x11c8c7d, 0x39}, {0xc0000f6180?, 0x10c85c0?, 0x1?}, {0xc00013fd60, 0xf}, 0xc00056bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae4c0?, 0xc0007283c0?}, {0xc000050e40, 0x52}, {0x1?}, {0xc00056bea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00013fd60, 0xf}, {0xc000050e40, 0x52}, {0xf24d60, 0xc00046d1a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583040, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.636s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a025e67ff09e5f5682b98784a5f23e5958a8e5fea2f509fd00c43c20fa15a020
Associated tags:
- 20230429-023139
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-023139
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230429-023139].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a025e67ff09e5f5682b98784a5f23e5958a8e5fea2f509fd00c43c20fa15a020].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429022034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a55373c3624762ea03a342190eb30806ce0b239ca012ccf02c7000f66175343]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230429022034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a55373c3624762ea03a342190eb30806ce0b239ca012ccf02c7000f66175343])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a55373c3624762ea03a342190eb30806ce0b239ca012ccf02c7000f66175343
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a55373c3624762ea03a342190eb30806ce0b239ca012ccf02c7000f66175343].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429022034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:186bd299075cf11b8884491f559dbe39abb7c8d7d8317459b56533975f2c8eef]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230429022034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:186bd299075cf11b8884491f559dbe39abb7c8d7d8317459b56533975f2c8eef])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:186bd299075cf11b8884491f559dbe39abb7c8d7d8317459b56533975f2c8eef
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:186bd299075cf11b8884491f559dbe39abb7c8d7d8317459b56533975f2c8eef].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 43s
232 actionable tasks: 161 executed, 59 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/hfi4mm6apgqgo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1582
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1582/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428202040",
"environmentId": "daDHkIrdhabeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-203259"
}
]
},
"name": "go-testxlang_partition-509",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/28 21:16:09 Submitted job: 2023-04-28_14_16_08-9343881146919676643
2023/04/28 21:16:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-28_14_16_08-9343881146919676643?project=apache-beam-testing
2023/04/28 21:16:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-28_14_16_08-9343881146919676643
2023/04/28 21:16:09 Job state: JOB_STATE_PENDING ...
2023/04/28 21:16:39 Job still running ...
2023/04/28 21:17:09 Job still running ...
2023/04/28 21:17:39 Job still running ...
2023/04/28 21:18:09 Job still running ...
2023/04/28 21:18:39 Job still running ...
2023/04/28 21:19:09 Job still running ...
2023/04/28 21:19:39 Job still running ...
2023/04/28 21:20:09 Job still running ...
2023/04/28 21:20:39 Job still running ...
2023/04/28 21:21:09 Job still running ...
2023/04/28 21:21:39 Job still running ...
2023/04/28 21:22:09 Job still running ...
2023/04/28 21:22:39 Job still running ...
2023/04/28 21:23:09 Job still running ...
2023/04/28 21:23:39 Job still running ...
2023/04/28 21:24:10 Job still running ...
2023/04/28 21:24:40 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-28_14_16_08-9343881146919676643 failed
--- FAIL: TestXLang_Partition (551.78s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3094.621s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682714024400251798
--- FAIL: TestBigQueryIO_BasicWriteRead (5.08s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36691 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@iRFifExsyZ" is_bounded:BOUNDED windowing_strategy_id:"w0@iRFifExsyZ"}} windowing_strategies:{key:"w0@iRFifExsyZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@iRFifExsyZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@iRFifExsyZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@iRFifExsyZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682714024400251798\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"iRFifExsyZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36691 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@iRFifExsyZ" is_bounded:BOUNDED windowing_strategy_id:"w0@iRFifExsyZ"}} windowing_strategies:{key:"w0@iRFifExsyZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@iRFifExsyZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@iRFifExsyZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@iRFifExsyZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682714024400251798\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"iRFifExsyZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 16 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0002847c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0002847c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae9c0?, 0xc0005743c0?}, {0x11c8c7d, 0x39}, {0xc0000f6180?, 0x10c85c0?, 0x1?}, {0xc000149d60, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae4e0?, 0xc0005743c0?}, {0xc000050e40, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000149d60, 0xf}, {0xc000050e40, 0x52}, {0xf24d60, 0xc00046b210})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103d40, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.109s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.071s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30729c6db7b405d8d83dc91f0529e6621433bd78420483a45be6a9e490501537
Associated tags:
- 20230428-203259
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-203259
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-203259].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30729c6db7b405d8d83dc91f0529e6621433bd78420483a45be6a9e490501537].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a112564a253c878f36725bc7d80b0af0957a62fffe932774598eea168ddc4f96]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a112564a253c878f36725bc7d80b0af0957a62fffe932774598eea168ddc4f96])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a112564a253c878f36725bc7d80b0af0957a62fffe932774598eea168ddc4f96
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a112564a253c878f36725bc7d80b0af0957a62fffe932774598eea168ddc4f96].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fecc33c50aa41078e80720421d9493c46a380bbdd43bfc8bc01a870943a850bb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fecc33c50aa41078e80720421d9493c46a380bbdd43bfc8bc01a870943a850bb])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fecc33c50aa41078e80720421d9493c46a380bbdd43bfc8bc01a870943a850bb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fecc33c50aa41078e80720421d9493c46a380bbdd43bfc8bc01a870943a850bb].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 7s
232 actionable tasks: 162 executed, 58 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ndbzji5zpzbgu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1581
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1581/display/redirect?page=changes>
Changes:
[noreply] [Go SDK] Timers with new datalayer (#26101)
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428142044",
"environmentId": "AIUzplfLWRbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1",
"beam:coder:timer:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-143416",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-143416"
}
]
},
"name": "go-testxlang_partition-213",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/28 15:11:54 Submitted job: 2023-04-28_08_11_53-5311385391216240686
2023/04/28 15:11:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-28_08_11_53-5311385391216240686?project=apache-beam-testing
2023/04/28 15:11:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-28_08_11_53-5311385391216240686
2023/04/28 15:11:54 Job state: JOB_STATE_PENDING ...
2023/04/28 15:12:24 Job still running ...
2023/04/28 15:12:54 Job still running ...
2023/04/28 15:13:24 Job still running ...
2023/04/28 15:13:54 Job still running ...
2023/04/28 15:14:24 Job still running ...
2023/04/28 15:14:54 Job still running ...
2023/04/28 15:15:24 Job still running ...
2023/04/28 15:15:54 Job still running ...
2023/04/28 15:16:24 Job still running ...
2023/04/28 15:16:54 Job still running ...
2023/04/28 15:17:24 Job still running ...
2023/04/28 15:17:54 Job still running ...
2023/04/28 15:18:24 Job still running ...
2023/04/28 15:18:54 Job still running ...
ptest.go:108: Failed to execute job: failed to get job
caused by:
googleapi: Error 503: The service is currently unavailable., backendError
--- FAIL: TestXLang_Partition (490.30s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2704.761s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682692498005990637
--- FAIL: TestBigQueryIO_BasicWriteRead (5.90s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35701 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hnNLUEJANu" is_bounded:BOUNDED windowing_strategy_id:"w0@hnNLUEJANu"}} windowing_strategies:{key:"w0@hnNLUEJANu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hnNLUEJANu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hnNLUEJANu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hnNLUEJANu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682692498005990637\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hnNLUEJANu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35701 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hnNLUEJANu" is_bounded:BOUNDED windowing_strategy_id:"w0@hnNLUEJANu"}} windowing_strategies:{key:"w0@hnNLUEJANu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hnNLUEJANu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hnNLUEJANu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hnNLUEJANu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682692498005990637\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hnNLUEJANu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xfe0640, 0xc0003e2480})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfe0640, 0xc0003e2480})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000534f20?, 0xc000520460?}, {0x11c8c7d, 0x39}, {0xc000158180?, 0x10c85c0?, 0x1?}, {0xc000489f70, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000534ea0?, 0xc000520460?}, {0xc000050900, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xee0140?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f70, 0xf}, {0xc000050900, 0x52}, {0xf24d60, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005c2d00, 0x11fc298)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.954s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.034s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30d610756db2ac0da7eaa81cd99c5f2732ab4fa5efe797e945498ed6d90c7aa8
Associated tags:
- 20230428-143416
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-143416
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-143416].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30d610756db2ac0da7eaa81cd99c5f2732ab4fa5efe797e945498ed6d90c7aa8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49caf8cf955180e63631d86479884aa6ac752a69afff458c152ac2f00deba65d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49caf8cf955180e63631d86479884aa6ac752a69afff458c152ac2f00deba65d])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49caf8cf955180e63631d86479884aa6ac752a69afff458c152ac2f00deba65d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49caf8cf955180e63631d86479884aa6ac752a69afff458c152ac2f00deba65d].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f295b5a8513b29643ef178f611d72dfc966a20bb562ed6856fe2bcdfd1d756a5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f295b5a8513b29643ef178f611d72dfc966a20bb562ed6856fe2bcdfd1d756a5])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f295b5a8513b29643ef178f611d72dfc966a20bb562ed6856fe2bcdfd1d756a5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f295b5a8513b29643ef178f611d72dfc966a20bb562ed6856fe2bcdfd1d756a5].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 59m 44s
232 actionable tasks: 163 executed, 57 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/u7ek7ngfi5leq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1580
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1580/display/redirect>
Changes:
------------------------------------------
[...truncated 1013.39 KB...]
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-083222"
}
]
},
"name": "go-testxlang_multi-671",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/28 09:11:47 Submitted job: 2023-04-28_02_11_46-9287403910718445964
2023/04/28 09:11:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-28_02_11_46-9287403910718445964?project=apache-beam-testing
2023/04/28 09:11:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-28_02_11_46-9287403910718445964
2023/04/28 09:11:47 Job state: JOB_STATE_PENDING ...
2023/04/28 09:12:17 Job still running ...
2023/04/28 09:12:47 Job still running ...
2023/04/28 09:13:17 Job still running ...
2023/04/28 09:13:47 Job still running ...
2023/04/28 09:14:17 Job still running ...
2023/04/28 09:14:48 Job still running ...
2023/04/28 09:15:18 Job still running ...
2023/04/28 09:15:48 Job still running ...
2023/04/28 09:16:18 Job still running ...
2023/04/28 09:16:48 Job still running ...
2023/04/28 09:17:18 Job still running ...
2023/04/28 09:17:48 Job still running ...
2023/04/28 09:18:18 Job still running ...
2023/04/28 09:18:48 Job still running ...
2023/04/28 09:19:18 Job still running ...
2023/04/28 09:19:48 Job still running ...
2023/04/28 09:20:18 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-28_02_11_46-9287403910718445964 failed
--- FAIL: TestXLang_Multi (551.54s)
=== RUN TestXLang_Partition
--- FAIL: TestXLang_Partition (15.00s)
panic: tried cross-language for beam:transforms:xlang:test:partition against localhost:37063 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@TQKmCbGhJU" is_bounded:BOUNDED windowing_strategy_id:"w0@TQKmCbGhJU"}} windowing_strategies:{key:"w0@TQKmCbGhJU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@TQKmCbGhJU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TQKmCbGhJU" value:{spec:{urn:"beam:coder:varint:v1"}}} coders:{key:"c1@TQKmCbGhJU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transforms:xlang:test:partition"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"TQKmCbGhJU"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:37063: connect: connection refused" [recovered]
panic: tried cross-language for beam:transforms:xlang:test:partition against localhost:37063 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@TQKmCbGhJU" is_bounded:BOUNDED windowing_strategy_id:"w0@TQKmCbGhJU"}} windowing_strategies:{key:"w0@TQKmCbGhJU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@TQKmCbGhJU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TQKmCbGhJU" value:{spec:{urn:"beam:coder:varint:v1"}}} coders:{key:"c1@TQKmCbGhJU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transforms:xlang:test:partition"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"TQKmCbGhJU"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:37063: connect: connection refused"
goroutine 1744 [running]:
testing.tRunner.func1.2({0xe54980, 0xc0004af040})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xe54980, 0xc0004af040})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00015b140?, 0xc0003b27d0?}, {0xfaa3b1, 0x24}, {0x0?, 0x10db7c0?, 0x40?}, {0x7ffd11f54092, 0xf}, 0xc0000efc60, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/examples/xlang.Partition({0xc00015af20?, 0xc0003b27d0?}, {0x7ffd11f54092, 0xf}, {0x531c33?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/examples/xlang/transforms.go>:106 +0x368
github.com/apache/beam/sdks/v2/go/test/integration/xlang.TestXLang_Partition(0xc0005b44e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/xlang/xlang_test.go>:256 +0x19e
testing.tRunner(0xc0005b44e0, 0xff1328)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2890.766s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682670780817839104
--- FAIL: TestBigQueryIO_BasicWriteRead (5.34s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45883 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JryiyqEgAn" is_bounded:BOUNDED windowing_strategy_id:"w0@JryiyqEgAn"}} windowing_strategies:{key:"w0@JryiyqEgAn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JryiyqEgAn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JryiyqEgAn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JryiyqEgAn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682670780817839104\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JryiyqEgAn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45883 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JryiyqEgAn" is_bounded:BOUNDED windowing_strategy_id:"w0@JryiyqEgAn"}} windowing_strategies:{key:"w0@JryiyqEgAn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JryiyqEgAn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JryiyqEgAn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JryiyqEgAn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682670780817839104\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JryiyqEgAn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc0005b2480})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc0005b2480})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000656080?, 0xc0000c4280?}, {0x11c3bf0, 0x39}, {0xc0000f60c0?, 0x10c3940?, 0xc0006500c0?}, {0xc000139de0, 0xf}, 0xc000571d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000656020?, 0xc0000c4280?}, {0xc0001787e0, 0x52}, {0x1?}, {0xc000571ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000139de0, 0xf}, {0xc0001787e0, 0x52}, {0xf20680, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642b60, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.368s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.045s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e20d6506ccefc6f54a29a7453f4620a3e1e78ca3bd10fb4b9c41b785e160e229
Associated tags:
- 20230428-083222
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-083222
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-083222].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e20d6506ccefc6f54a29a7453f4620a3e1e78ca3bd10fb4b9c41b785e160e229].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a719e24f7a2ec0d2e16b9755b5367a927ab5bce7fdd42c05ab64218bcd46b8e4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a719e24f7a2ec0d2e16b9755b5367a927ab5bce7fdd42c05ab64218bcd46b8e4])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a719e24f7a2ec0d2e16b9755b5367a927ab5bce7fdd42c05ab64218bcd46b8e4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a719e24f7a2ec0d2e16b9755b5367a927ab5bce7fdd42c05ab64218bcd46b8e4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:59f7ca6a8c55c9ad3ca5b58fa2190129ccea7c13b9d13f236b3bbacb9e6cf3e9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:59f7ca6a8c55c9ad3ca5b58fa2190129ccea7c13b9d13f236b3bbacb9e6cf3e9])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:59f7ca6a8c55c9ad3ca5b58fa2190129ccea7c13b9d13f236b3bbacb9e6cf3e9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:59f7ca6a8c55c9ad3ca5b58fa2190129ccea7c13b9d13f236b3bbacb9e6cf3e9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 55s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/bgse56ub5j33a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1579
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1579/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428030519",
"environmentId": "DJDtVKjPqxbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-032203"
}
]
},
"name": "go-testxlang_partition-833",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/28 04:08:48 Submitted job: 2023-04-27_21_08_47-9491984644413186719
2023/04/28 04:08:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-27_21_08_47-9491984644413186719?project=apache-beam-testing
2023/04/28 04:08:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-27_21_08_47-9491984644413186719
2023/04/28 04:08:48 Job state: JOB_STATE_PENDING ...
2023/04/28 04:09:18 Job still running ...
2023/04/28 04:09:48 Job still running ...
2023/04/28 04:10:18 Job still running ...
2023/04/28 04:10:48 Job still running ...
2023/04/28 04:11:18 Job still running ...
2023/04/28 04:11:48 Job still running ...
2023/04/28 04:12:18 Job still running ...
2023/04/28 04:12:48 Job still running ...
2023/04/28 04:13:18 Job still running ...
2023/04/28 04:13:48 Job still running ...
2023/04/28 04:14:18 Job still running ...
2023/04/28 04:14:48 Job still running ...
2023/04/28 04:15:18 Job still running ...
2023/04/28 04:15:48 Job still running ...
2023/04/28 04:16:18 Job still running ...
2023/04/28 04:16:48 Job still running ...
2023/04/28 04:17:18 Job still running ...
2023/04/28 04:17:48 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-27_21_08_47-9491984644413186719 failed
--- FAIL: TestXLang_Partition (581.78s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3273.378s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682652229760960948
--- FAIL: TestBigQueryIO_BasicWriteRead (12.76s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43171 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JXRapRdRyC" is_bounded:BOUNDED windowing_strategy_id:"w0@JXRapRdRyC"}} windowing_strategies:{key:"w0@JXRapRdRyC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JXRapRdRyC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JXRapRdRyC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JXRapRdRyC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682652229760960948\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JXRapRdRyC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43171 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JXRapRdRyC" is_bounded:BOUNDED windowing_strategy_id:"w0@JXRapRdRyC"}} windowing_strategies:{key:"w0@JXRapRdRyC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JXRapRdRyC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JXRapRdRyC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JXRapRdRyC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682652229760960948\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JXRapRdRyC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc000742980})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc000742980})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005a8080?, 0xc000158870?}, {0x11c3bf0, 0x39}, {0xc0005c2000?, 0x10c3940?, 0xc0005a20c0?}, {0xc00046d120, 0xf}, 0xc000547d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005a8020?, 0xc000158870?}, {0xc000050b40, 0x52}, {0x1?}, {0xc000547ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046d120, 0xf}, {0xc000050b40, 0x52}, {0xf20680, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d7040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d7040, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 15.849s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.114s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.140s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.109s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8cf97271270ca49b5e877d6bbf282180e360f0bd8bbb9544470c5edf847fa7bc
Associated tags:
- 20230428-032203
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-032203
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230428-032203].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8cf97271270ca49b5e877d6bbf282180e360f0bd8bbb9544470c5edf847fa7bc].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428030519]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e8881f7a816accfa17ddffb6e38fae534789b96cfa05a00b054e75ebe12900e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230428030519] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e8881f7a816accfa17ddffb6e38fae534789b96cfa05a00b054e75ebe12900e])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e8881f7a816accfa17ddffb6e38fae534789b96cfa05a00b054e75ebe12900e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6e8881f7a816accfa17ddffb6e38fae534789b96cfa05a00b054e75ebe12900e].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428030519]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:98ed237a0353e0aa287a5ab6f0f1ea9a30199739b630f37426832811d6f5c877]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230428030519] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:98ed237a0353e0aa287a5ab6f0f1ea9a30199739b630f37426832811d6f5c877])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:98ed237a0353e0aa287a5ab6f0f1ea9a30199739b630f37426832811d6f5c877
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:98ed237a0353e0aa287a5ab6f0f1ea9a30199739b630f37426832811d6f5c877].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 14m 9s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/7a4433l7r2te4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1578
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1578/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427220821",
"environmentId": "YKpNqMyzwlbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-222106"
}
]
},
"name": "go-testxlang_partition-168",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/27 23:09:02 Submitted job: 2023-04-27_16_09_01-9474624433510895349
2023/04/27 23:09:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-27_16_09_01-9474624433510895349?project=apache-beam-testing
2023/04/27 23:09:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-27_16_09_01-9474624433510895349
2023/04/27 23:09:02 Job state: JOB_STATE_PENDING ...
2023/04/27 23:09:32 Job still running ...
2023/04/27 23:10:02 Job still running ...
2023/04/27 23:10:32 Job still running ...
2023/04/27 23:11:02 Job still running ...
2023/04/27 23:11:32 Job still running ...
2023/04/27 23:12:02 Job still running ...
2023/04/27 23:12:32 Job still running ...
2023/04/27 23:13:02 Job still running ...
2023/04/27 23:13:32 Job still running ...
2023/04/27 23:14:02 Job still running ...
2023/04/27 23:14:32 Job still running ...
2023/04/27 23:15:02 Job still running ...
2023/04/27 23:15:32 Job still running ...
2023/04/27 23:16:02 Job still running ...
2023/04/27 23:16:32 Job still running ...
2023/04/27 23:17:02 Job still running ...
2023/04/27 23:17:32 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-27_16_09_01-9474624433510895349 failed
--- FAIL: TestXLang_Partition (550.48s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3335.734s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682634175572426236
--- FAIL: TestBigQueryIO_BasicWriteRead (12.07s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42165 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QwNBsUgdKQ" is_bounded:BOUNDED windowing_strategy_id:"w0@QwNBsUgdKQ"}} windowing_strategies:{key:"w0@QwNBsUgdKQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QwNBsUgdKQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QwNBsUgdKQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QwNBsUgdKQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682634175572426236\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QwNBsUgdKQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42165 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QwNBsUgdKQ" is_bounded:BOUNDED windowing_strategy_id:"w0@QwNBsUgdKQ"}} windowing_strategies:{key:"w0@QwNBsUgdKQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QwNBsUgdKQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QwNBsUgdKQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QwNBsUgdKQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682634175572426236\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QwNBsUgdKQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc000546340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc000546340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004cb280?, 0xc0000c5b30?}, {0x11c3bf0, 0x39}, {0xc0000f6180?, 0x10c3940?, 0xc00059de90?}, {0xc0003ecc70, 0xf}, 0xc0004edd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004cb220?, 0xc0000c5b30?}, {0xc000050b40, 0x52}, {0x1?}, {0xc0004edea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003ecc70, 0xf}, {0xc000050b40, 0x52}, {0xf20680, 0xc000530650})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000457380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000457380, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 15.198s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.115s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.083s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.140s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:75dd39db335c02d2d24595fce586ae33dca542dd392c3cd9785cec9ad5532610
Associated tags:
- 20230427-222106
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-222106
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-222106].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:75dd39db335c02d2d24595fce586ae33dca542dd392c3cd9785cec9ad5532610].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427220821]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0edff10f4b8a935bdabd201f65134c8fee60aed95efe8e69b5ce01dcfb078e8a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427220821] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0edff10f4b8a935bdabd201f65134c8fee60aed95efe8e69b5ce01dcfb078e8a])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0edff10f4b8a935bdabd201f65134c8fee60aed95efe8e69b5ce01dcfb078e8a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0edff10f4b8a935bdabd201f65134c8fee60aed95efe8e69b5ce01dcfb078e8a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427220821]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fbea66e78acf0f8bf4920f89c120263d1941f790ce3e1bada005867b7e8fd2b2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427220821] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fbea66e78acf0f8bf4920f89c120263d1941f790ce3e1bada005867b7e8fd2b2])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fbea66e78acf0f8bf4920f89c120263d1941f790ce3e1bada005867b7e8fd2b2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fbea66e78acf0f8bf4920f89c120263d1941f790ce3e1bada005867b7e8fd2b2].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 9s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/mg7y2uiktyoow
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1577
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1577/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427143134",
"environmentId": "FHmTiNPHpFbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-144614"
}
]
},
"name": "go-testxlang_partition-31",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/27 15:26:52 Submitted job: 2023-04-27_08_26_51-10741233038475669672
2023/04/27 15:26:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-27_08_26_51-10741233038475669672?project=apache-beam-testing
2023/04/27 15:26:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-27_08_26_51-10741233038475669672
2023/04/27 15:26:52 Job state: JOB_STATE_PENDING ...
2023/04/27 15:27:22 Job still running ...
2023/04/27 15:27:52 Job still running ...
2023/04/27 15:28:22 Job still running ...
2023/04/27 15:28:52 Job still running ...
2023/04/27 15:29:22 Job still running ...
2023/04/27 15:29:52 Job still running ...
2023/04/27 15:30:22 Job still running ...
2023/04/27 15:30:52 Job still running ...
2023/04/27 15:31:22 Job still running ...
2023/04/27 15:31:52 Job still running ...
2023/04/27 15:32:22 Job still running ...
2023/04/27 15:32:52 Job still running ...
2023/04/27 15:33:22 Job still running ...
2023/04/27 15:33:52 Job still running ...
2023/04/27 15:34:22 Job still running ...
2023/04/27 15:34:53 Job still running ...
2023/04/27 15:35:23 Job still running ...
2023/04/27 15:35:53 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-27_08_26_51-10741233038475669672 failed
--- FAIL: TestXLang_Partition (590.52s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2956.447s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682606836325051220
--- FAIL: TestBigQueryIO_BasicWriteRead (9.62s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32885 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@yvxDzRQgAv" is_bounded:BOUNDED windowing_strategy_id:"w0@yvxDzRQgAv"}} windowing_strategies:{key:"w0@yvxDzRQgAv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@yvxDzRQgAv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@yvxDzRQgAv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@yvxDzRQgAv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682606836325051220\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"yvxDzRQgAv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32885 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@yvxDzRQgAv" is_bounded:BOUNDED windowing_strategy_id:"w0@yvxDzRQgAv"}} windowing_strategies:{key:"w0@yvxDzRQgAv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@yvxDzRQgAv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@yvxDzRQgAv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@yvxDzRQgAv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682606836325051220\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"yvxDzRQgAv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc000318580})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc000318580})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005c0fc0?, 0xc00012fc70?}, {0x11c3bf0, 0x39}, {0xc0001500c0?, 0x10c3940?, 0xc000000f60?}, {0xc0004812b0, 0xf}, 0xc000033d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005c0f60?, 0xc00012fc70?}, {0xc000100900, 0x52}, {0x1?}, {0xc000033ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0004812b0, 0xf}, {0xc000100900, 0x52}, {0xf20680, 0xc0005df2a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000349520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000349520, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 12.712s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.113s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.098s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.109s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-144614
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-144614
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2a78fdfdceb7ba1a0901ca07b49e25b08f240d1663cc89665371cb63ce5c1eab
Deleted: sha256:2abaea78f3ad851d8cb7f9db319523baad3952301ab207d6152201718f0dd4eb
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-144614
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2a78fdfdceb7ba1a0901ca07b49e25b08f240d1663cc89665371cb63ce5c1eab
Associated tags:
- 20230427-144614
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-144614
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-144614].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2a78fdfdceb7ba1a0901ca07b49e25b08f240d1663cc89665371cb63ce5c1eab].
$ rm -rf /tmp/tmp.AORNZrMoIP
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427143134
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:302bb2b83590d59f8746e7d9da0803d393c1ee4f40cdac0ed93d4f3014f0d25f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427143134]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:302bb2b83590d59f8746e7d9da0803d393c1ee4f40cdac0ed93d4f3014f0d25f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427143134] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:302bb2b83590d59f8746e7d9da0803d393c1ee4f40cdac0ed93d4f3014f0d25f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:302bb2b83590d59f8746e7d9da0803d393c1ee4f40cdac0ed93d4f3014f0d25f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:302bb2b83590d59f8746e7d9da0803d393c1ee4f40cdac0ed93d4f3014f0d25f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:302bb2b83590d59f8746e7d9da0803d393c1ee4f40cdac0ed93d4f3014f0d25f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427143134
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d381bf30cbaa591686a714f2ca06b849c30c9a3312d97a6f4ced748603dd719
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427143134]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d381bf30cbaa591686a714f2ca06b849c30c9a3312d97a6f4ced748603dd719]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427143134] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d381bf30cbaa591686a714f2ca06b849c30c9a3312d97a6f4ced748603dd719])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d381bf30cbaa591686a714f2ca06b849c30c9a3312d97a6f4ced748603dd719
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d381bf30cbaa591686a714f2ca06b849c30c9a3312d97a6f4ced748603dd719
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d381bf30cbaa591686a714f2ca06b849c30c9a3312d97a6f4ced748603dd719].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1292741.
Stopping expansion service pid: 1292742.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 21s
232 actionable tasks: 167 executed, 53 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/q6klsdh3dylhc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1576
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1576/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #26443 from kennknowles/hcatalog-nullness
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427082028",
"environmentId": "YqFnspqMmYbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-083049"
}
]
},
"name": "go-testxlang_partition-1",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/27 09:15:18 Submitted job: 2023-04-27_02_15_17-3223627525753573476
2023/04/27 09:15:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-27_02_15_17-3223627525753573476?project=apache-beam-testing
2023/04/27 09:15:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-27_02_15_17-3223627525753573476
2023/04/27 09:15:18 Job state: JOB_STATE_PENDING ...
2023/04/27 09:15:48 Job still running ...
2023/04/27 09:16:18 Job still running ...
2023/04/27 09:16:48 Job still running ...
2023/04/27 09:17:18 Job still running ...
2023/04/27 09:17:48 Job still running ...
2023/04/27 09:18:18 Job still running ...
2023/04/27 09:18:48 Job still running ...
2023/04/27 09:19:18 Job still running ...
2023/04/27 09:19:48 Job still running ...
2023/04/27 09:20:18 Job still running ...
2023/04/27 09:20:49 Job still running ...
2023/04/27 09:21:19 Job still running ...
2023/04/27 09:21:49 Job still running ...
2023/04/27 09:22:19 Job still running ...
2023/04/27 09:22:49 Job still running ...
2023/04/27 09:23:19 Job still running ...
2023/04/27 09:23:49 Job still running ...
2023/04/27 09:24:19 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-27_02_15_17-3223627525753573476 failed
--- FAIL: TestXLang_Partition (581.66s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3209.719s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682584283185865487
--- FAIL: TestBigQueryIO_BasicWriteRead (4.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45177 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hZIVkRiwqn" is_bounded:BOUNDED windowing_strategy_id:"w0@hZIVkRiwqn"}} windowing_strategies:{key:"w0@hZIVkRiwqn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hZIVkRiwqn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hZIVkRiwqn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hZIVkRiwqn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682584283185865487\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hZIVkRiwqn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45177 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hZIVkRiwqn" is_bounded:BOUNDED windowing_strategy_id:"w0@hZIVkRiwqn"}} windowing_strategies:{key:"w0@hZIVkRiwqn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hZIVkRiwqn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hZIVkRiwqn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hZIVkRiwqn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682584283185865487\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hZIVkRiwqn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 67 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc000156900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc000156900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ec080?, 0xc000136230?}, {0x11c3bf0, 0x39}, {0xc0001580c0?, 0x10c3940?, 0xc0000e60c0?}, {0xc000045f50, 0xf}, 0xc000217d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ec020?, 0xc000136230?}, {0xc000050900, 0x52}, {0x1?}, {0xc000217ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc000050900, 0x52}, {0xf20680, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000d91e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000d91e0, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.644s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9bc5e7a937659e4b7c6823c8f8c78210674f41338d5b1499eb8f0dcc5d7c0e6e
Associated tags:
- 20230427-083049
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-083049
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-083049].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9bc5e7a937659e4b7c6823c8f8c78210674f41338d5b1499eb8f0dcc5d7c0e6e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5854fc268011d74fe37bc4298b6be83f79a6964c153806887897ec14b1935040]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5854fc268011d74fe37bc4298b6be83f79a6964c153806887897ec14b1935040])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5854fc268011d74fe37bc4298b6be83f79a6964c153806887897ec14b1935040
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5854fc268011d74fe37bc4298b6be83f79a6964c153806887897ec14b1935040].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:95e8dfd823a848ab419d3c84a364ebc90686d91274b227b1b76e2fc9d2159843]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:95e8dfd823a848ab419d3c84a364ebc90686d91274b227b1b76e2fc9d2159843])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:95e8dfd823a848ab419d3c84a364ebc90686d91274b227b1b76e2fc9d2159843
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:95e8dfd823a848ab419d3c84a364ebc90686d91274b227b1b76e2fc9d2159843].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 46s
232 actionable tasks: 171 executed, 49 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/y6ax5wcnbjs3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1575
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1575/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-023056",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-023056"
}
]
},
"name": "go-testxlang_partition-984",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/27 03:15:04 Submitted job: 2023-04-26_20_15_03-2059809381868849853
2023/04/27 03:15:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-26_20_15_03-2059809381868849853?project=apache-beam-testing
2023/04/27 03:15:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-26_20_15_03-2059809381868849853
2023/04/27 03:15:04 Job state: JOB_STATE_PENDING ...
2023/04/27 03:15:34 Job still running ...
2023/04/27 03:16:04 Job still running ...
2023/04/27 03:16:34 Job still running ...
2023/04/27 03:17:04 Job still running ...
2023/04/27 03:17:34 Job still running ...
2023/04/27 03:18:04 Job still running ...
2023/04/27 03:18:34 Job still running ...
2023/04/27 03:19:04 Job still running ...
2023/04/27 03:19:34 Job still running ...
2023/04/27 03:20:05 Job still running ...
2023/04/27 03:20:35 Job still running ...
2023/04/27 03:21:05 Job still running ...
2023/04/27 03:21:35 Job still running ...
2023/04/27 03:22:05 Job still running ...
2023/04/27 03:22:35 Job still running ...
2023/04/27 03:23:05 Job still running ...
2023/04/27 03:23:35 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-26_20_15_03-2059809381868849853 failed
--- FAIL: TestXLang_Partition (551.42s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3155.546s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682562693253725817
--- FAIL: TestBigQueryIO_BasicWriteRead (4.35s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33763 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WlGrYezumG" is_bounded:BOUNDED windowing_strategy_id:"w0@WlGrYezumG"}} windowing_strategies:{key:"w0@WlGrYezumG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WlGrYezumG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WlGrYezumG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WlGrYezumG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682562693253725817\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WlGrYezumG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33763 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WlGrYezumG" is_bounded:BOUNDED windowing_strategy_id:"w0@WlGrYezumG"}} windowing_strategies:{key:"w0@WlGrYezumG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WlGrYezumG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WlGrYezumG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WlGrYezumG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682562693253725817\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WlGrYezumG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 22 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc0004d8e40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc0004d8e40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e0a0?, 0xc000532000?}, {0x11c3bf0, 0x39}, {0xc00055c000?, 0x10c3940?, 0xc00052a0c0?}, {0xc00046de80, 0xf}, 0xc00017bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc000532000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc00017bea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de80, 0xf}, {0xc000050e40, 0x52}, {0xf20680, 0xc000702068})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d7ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d7ba0, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.375s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.032s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-023056
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-023056
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ade403432226034706879c36546241dbb1dce556a92cdd0a5f535708acd9f045
Deleted: sha256:c58a9514f4ef9126cd38ea07bec213d3176e14906a8659e6f3534a2a2f112bfa
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-023056
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ade403432226034706879c36546241dbb1dce556a92cdd0a5f535708acd9f045
Associated tags:
- 20230427-023056
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-023056
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230427-023056].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ade403432226034706879c36546241dbb1dce556a92cdd0a5f535708acd9f045].
$ rm -rf /tmp/tmp.sSXA8t7PcW
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427022032
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b46d5f0c290340c8b99b052b6989a43fd8305baab8b67b3a3f20a7fe6a062f36
Deleted: sha256:ab1ecb9fcea46b141f44c640624a5ee023edea0e50f89adfab00b5097c26baad
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427022032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b46d5f0c290340c8b99b052b6989a43fd8305baab8b67b3a3f20a7fe6a062f36]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230427022032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b46d5f0c290340c8b99b052b6989a43fd8305baab8b67b3a3f20a7fe6a062f36])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b46d5f0c290340c8b99b052b6989a43fd8305baab8b67b3a3f20a7fe6a062f36
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b46d5f0c290340c8b99b052b6989a43fd8305baab8b67b3a3f20a7fe6a062f36
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b46d5f0c290340c8b99b052b6989a43fd8305baab8b67b3a3f20a7fe6a062f36].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427022032
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c274d5c1d97effac158ff3ce39c34b516f1e25c318f315ed7141468506ccc9fa
Deleted: sha256:fdd2bc7179a043d30bb7fc60fe24fe212406cfb71245011c58e9b86df8428979
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427022032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c274d5c1d97effac158ff3ce39c34b516f1e25c318f315ed7141468506ccc9fa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230427022032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c274d5c1d97effac158ff3ce39c34b516f1e25c318f315ed7141468506ccc9fa])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c274d5c1d97effac158ff3ce39c34b516f1e25c318f315ed7141468506ccc9fa
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c274d5c1d97effac158ff3ce39c34b516f1e25c318f315ed7141468506ccc9fa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c274d5c1d97effac158ff3ce39c34b516f1e25c318f315ed7141468506ccc9fa].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2969557.
Stopping expansion service pid: 2969558.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 1s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/4egr7mpvophvw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1574
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1574/display/redirect>
Changes:
------------------------------------------
[...truncated 1012.35 KB...]
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426203918",
"environmentId": "AYrIWNdkUnbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-205408"
}
]
},
"name": "go-testxlang_partition-857",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/26 21:40:21 Submitted job: 2023-04-26_14_40_21-7748112066828509757
2023/04/26 21:40:21 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-26_14_40_21-7748112066828509757?project=apache-beam-testing
2023/04/26 21:40:21 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-26_14_40_21-7748112066828509757
2023/04/26 21:40:21 Job state: JOB_STATE_PENDING ...
2023/04/26 21:40:51 Job still running ...
2023/04/26 21:41:21 Job still running ...
2023/04/26 21:41:51 Job still running ...
2023/04/26 21:42:21 Job still running ...
2023/04/26 21:42:52 Job still running ...
2023/04/26 21:43:22 Job still running ...
2023/04/26 21:43:52 Job still running ...
2023/04/26 21:44:22 Job still running ...
2023/04/26 21:44:52 Job still running ...
2023/04/26 21:45:22 Job still running ...
2023/04/26 21:45:52 Job still running ...
2023/04/26 21:46:22 Job still running ...
2023/04/26 21:46:52 Job still running ...
2023/04/26 21:47:22 Job still running ...
2023/04/26 21:47:52 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-26_14_40_21-7748112066828509757 failed
--- FAIL: TestXLang_Partition (490.15s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3212.512s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682542497829740301
--- FAIL: TestBigQueryIO_BasicWriteRead (6.25s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32879 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xFdVEmUUAx" is_bounded:BOUNDED windowing_strategy_id:"w0@xFdVEmUUAx"}} windowing_strategies:{key:"w0@xFdVEmUUAx" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xFdVEmUUAx" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xFdVEmUUAx" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xFdVEmUUAx" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682542497829740301\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xFdVEmUUAx"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32879 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xFdVEmUUAx" is_bounded:BOUNDED windowing_strategy_id:"w0@xFdVEmUUAx"}} windowing_strategies:{key:"w0@xFdVEmUUAx" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xFdVEmUUAx" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xFdVEmUUAx" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xFdVEmUUAx" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682542497829740301\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xFdVEmUUAx"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 22 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc0006264c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc0006264c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00051c080?, 0xc000520000?}, {0x11c3bf0, 0x39}, {0xc0000f60c0?, 0x10c3940?, 0xc0005140c0?}, {0xc00046de10, 0xf}, 0xc000205d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00051c020?, 0xc000520000?}, {0xc000050de0, 0x52}, {0x1?}, {0xc000205ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050de0, 0x52}, {0xf20680, 0xc00012a088})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d7d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d7d40, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.282s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.054s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4c08495eeb969136f10fb3fe72a4870a4873dac10cb66f78c91341048cf0059b
Associated tags:
- 20230426-205408
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-205408
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-205408].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4c08495eeb969136f10fb3fe72a4870a4873dac10cb66f78c91341048cf0059b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426203918]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2b28ca3a3f70789d164de64de38537980ef911c213a5386f9bafa327485c0a3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426203918] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2b28ca3a3f70789d164de64de38537980ef911c213a5386f9bafa327485c0a3])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2b28ca3a3f70789d164de64de38537980ef911c213a5386f9bafa327485c0a3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2b28ca3a3f70789d164de64de38537980ef911c213a5386f9bafa327485c0a3].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426203918]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:41a83b814e770a321cbcd42ca959c054b72e7b8685bca337a5a65dfc2ebbcbc2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426203918] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:41a83b814e770a321cbcd42ca959c054b72e7b8685bca337a5a65dfc2ebbcbc2])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:41a83b814e770a321cbcd42ca959c054b72e7b8685bca337a5a65dfc2ebbcbc2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:41a83b814e770a321cbcd42ca959c054b72e7b8685bca337a5a65dfc2ebbcbc2].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 43s
232 actionable tasks: 153 executed, 67 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/xgx35vw7y7dma
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1573
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1573/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #25713 from RustedBones/beam-gcp-test-lib-provided
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426142545",
"environmentId": "cNVolozIaKbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-143722"
}
]
},
"name": "go-testxlang_partition-465",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/26 15:22:03 Submitted job: 2023-04-26_08_22_03-7276064023893292083
2023/04/26 15:22:03 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-26_08_22_03-7276064023893292083?project=apache-beam-testing
2023/04/26 15:22:03 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-26_08_22_03-7276064023893292083
2023/04/26 15:22:03 Job state: JOB_STATE_PENDING ...
2023/04/26 15:22:33 Job still running ...
2023/04/26 15:23:03 Job still running ...
2023/04/26 15:23:33 Job still running ...
2023/04/26 15:24:03 Job still running ...
2023/04/26 15:24:33 Job still running ...
2023/04/26 15:25:03 Job still running ...
2023/04/26 15:25:34 Job still running ...
2023/04/26 15:26:04 Job still running ...
2023/04/26 15:26:34 Job still running ...
2023/04/26 15:27:04 Job still running ...
2023/04/26 15:27:34 Job still running ...
2023/04/26 15:28:04 Job still running ...
2023/04/26 15:28:34 Job still running ...
2023/04/26 15:29:04 Job still running ...
2023/04/26 15:29:34 Job still running ...
2023/04/26 15:30:04 Job still running ...
2023/04/26 15:30:34 Job still running ...
2023/04/26 15:31:04 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-26_08_22_03-7276064023893292083 failed
--- FAIL: TestXLang_Partition (580.42s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3219.814s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682519882787092339
--- FAIL: TestBigQueryIO_BasicWriteRead (5.40s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46007 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@zgkYFleJhT" is_bounded:BOUNDED windowing_strategy_id:"w0@zgkYFleJhT"}} windowing_strategies:{key:"w0@zgkYFleJhT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@zgkYFleJhT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@zgkYFleJhT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@zgkYFleJhT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682519882787092339\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"zgkYFleJhT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46007 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@zgkYFleJhT" is_bounded:BOUNDED windowing_strategy_id:"w0@zgkYFleJhT"}} windowing_strategies:{key:"w0@zgkYFleJhT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@zgkYFleJhT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@zgkYFleJhT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@zgkYFleJhT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682519882787092339\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"zgkYFleJhT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc0005ce440})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc0005ce440})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00059e0c0?, 0xc0006da000?}, {0x11c3bf0, 0x39}, {0xc0006fe000?, 0x10c3940?, 0xc0006d20c0?}, {0xc000147d60, 0xf}, 0xc000573d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00059e060?, 0xc0006da000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc000573ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000147d60, 0xf}, {0xc000050e40, 0x52}, {0xf20680, 0xc000590088})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2d00, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.427s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.042s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-143722
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-143722
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e074f46726c9adb5b4ebf979ed5dcad148e61cb5de37b8113833ea0cfb7710f4
Deleted: sha256:dce37cec3082cb7653ed037603514b1d8000a08fd12b2658f026d3b38eb53095
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-143722
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e074f46726c9adb5b4ebf979ed5dcad148e61cb5de37b8113833ea0cfb7710f4
Associated tags:
- 20230426-143722
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-143722
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-143722].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e074f46726c9adb5b4ebf979ed5dcad148e61cb5de37b8113833ea0cfb7710f4].
$ rm -rf /tmp/tmp.VwcezJ4iuV
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426142545
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0fb1eb24513335e0b4b3d5aec81603c73f86e97f25b7547dfacbe5b519ea4a06
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426142545]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0fb1eb24513335e0b4b3d5aec81603c73f86e97f25b7547dfacbe5b519ea4a06]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426142545] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0fb1eb24513335e0b4b3d5aec81603c73f86e97f25b7547dfacbe5b519ea4a06])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0fb1eb24513335e0b4b3d5aec81603c73f86e97f25b7547dfacbe5b519ea4a06
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0fb1eb24513335e0b4b3d5aec81603c73f86e97f25b7547dfacbe5b519ea4a06
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0fb1eb24513335e0b4b3d5aec81603c73f86e97f25b7547dfacbe5b519ea4a06].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426142545
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1d60aed5f0f610575737c1cebf9445e674f3897772ec71a342c169578f3d3848
Deleted: sha256:62d6122d4068fd70498c02893910d63b09d166b57122719f890847f63a8c8592
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426142545]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1d60aed5f0f610575737c1cebf9445e674f3897772ec71a342c169578f3d3848]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426142545] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1d60aed5f0f610575737c1cebf9445e674f3897772ec71a342c169578f3d3848])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1d60aed5f0f610575737c1cebf9445e674f3897772ec71a342c169578f3d3848
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1d60aed5f0f610575737c1cebf9445e674f3897772ec71a342c169578f3d3848
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1d60aed5f0f610575737c1cebf9445e674f3897772ec71a342c169578f3d3848].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1074725.
Stopping expansion service pid: 1074726.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 23s
232 actionable tasks: 160 executed, 60 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/v62ksmfdcrgiy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1572
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1572/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426082031",
"environmentId": "URDMzifmnpbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-083054"
}
]
},
"name": "go-testxlang_partition-249",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/26 09:15:55 Submitted job: 2023-04-26_02_15_54-8045718353033626526
2023/04/26 09:15:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-26_02_15_54-8045718353033626526?project=apache-beam-testing
2023/04/26 09:15:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-26_02_15_54-8045718353033626526
2023/04/26 09:15:55 Job state: JOB_STATE_PENDING ...
2023/04/26 09:16:25 Job still running ...
2023/04/26 09:16:55 Job still running ...
2023/04/26 09:17:25 Job still running ...
2023/04/26 09:17:55 Job still running ...
2023/04/26 09:18:25 Job still running ...
2023/04/26 09:18:55 Job still running ...
2023/04/26 09:19:25 Job still running ...
2023/04/26 09:19:55 Job still running ...
2023/04/26 09:20:25 Job still running ...
2023/04/26 09:20:55 Job still running ...
2023/04/26 09:21:25 Job still running ...
2023/04/26 09:21:56 Job still running ...
2023/04/26 09:22:26 Job still running ...
2023/04/26 09:22:56 Job still running ...
2023/04/26 09:23:26 Job still running ...
2023/04/26 09:23:56 Job still running ...
2023/04/26 09:24:26 Job still running ...
2023/04/26 09:24:56 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-26_02_15_54-8045718353033626526 failed
--- FAIL: TestXLang_Partition (581.15s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3242.919s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682497887023044491
--- FAIL: TestBigQueryIO_BasicWriteRead (4.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44867 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@UxOhDfHgUm" is_bounded:BOUNDED windowing_strategy_id:"w0@UxOhDfHgUm"}} windowing_strategies:{key:"w0@UxOhDfHgUm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@UxOhDfHgUm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UxOhDfHgUm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@UxOhDfHgUm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682497887023044491\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"UxOhDfHgUm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44867 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@UxOhDfHgUm" is_bounded:BOUNDED windowing_strategy_id:"w0@UxOhDfHgUm"}} windowing_strategies:{key:"w0@UxOhDfHgUm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@UxOhDfHgUm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UxOhDfHgUm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@UxOhDfHgUm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682497887023044491\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"UxOhDfHgUm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 6 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc000516780})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc000516780})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00056c0a0?, 0xc000460000?}, {0x11c3bf0, 0x39}, {0xc0001d80c0?, 0x10c3940?, 0xc00019dd40?}, {0xc000509f80, 0xf}, 0xc000359d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00056c040?, 0xc000460000?}, {0xc00018ec60, 0x52}, {0x1?}, {0xc000359ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000509f80, 0xf}, {0xc00018ec60, 0x52}, {0xf20680, 0xc0001ae078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103040, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.361s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b55a278a9835000512ca8576f4119bb7af9d848cb41a75713a78f1306e812fb0
Associated tags:
- 20230426-083054
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-083054
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-083054].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b55a278a9835000512ca8576f4119bb7af9d848cb41a75713a78f1306e812fb0].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:93cf8415d96dee001d4f5f5ceee75bb5ea9f47f4f459e537fe64957dddedf0f6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:93cf8415d96dee001d4f5f5ceee75bb5ea9f47f4f459e537fe64957dddedf0f6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:93cf8415d96dee001d4f5f5ceee75bb5ea9f47f4f459e537fe64957dddedf0f6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:93cf8415d96dee001d4f5f5ceee75bb5ea9f47f4f459e537fe64957dddedf0f6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c5ff222ea6ee8d15f4ead97bb548a1f8fa6a48defc1fffec56fc0a3a7ee979e4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c5ff222ea6ee8d15f4ead97bb548a1f8fa6a48defc1fffec56fc0a3a7ee979e4])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c5ff222ea6ee8d15f4ead97bb548a1f8fa6a48defc1fffec56fc0a3a7ee979e4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c5ff222ea6ee8d15f4ead97bb548a1f8fa6a48defc1fffec56fc0a3a7ee979e4].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 20s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/hoxmxghkc2muq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1571
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1571/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426022045",
"environmentId": "MZIeSOdgQBbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-023116"
}
]
},
"name": "go-testxlang_partition-980",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/26 03:11:20 Submitted job: 2023-04-25_20_11_19-6183998804811155181
2023/04/26 03:11:20 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-25_20_11_19-6183998804811155181?project=apache-beam-testing
2023/04/26 03:11:20 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-25_20_11_19-6183998804811155181
2023/04/26 03:11:20 Job state: JOB_STATE_PENDING ...
2023/04/26 03:11:50 Job still running ...
2023/04/26 03:12:20 Job still running ...
2023/04/26 03:12:50 Job still running ...
2023/04/26 03:13:20 Job still running ...
2023/04/26 03:13:50 Job still running ...
2023/04/26 03:14:20 Job still running ...
2023/04/26 03:14:50 Job still running ...
2023/04/26 03:15:20 Job still running ...
2023/04/26 03:15:50 Job still running ...
2023/04/26 03:16:20 Job still running ...
2023/04/26 03:16:50 Job still running ...
2023/04/26 03:17:20 Job still running ...
2023/04/26 03:17:50 Job still running ...
2023/04/26 03:18:20 Job still running ...
2023/04/26 03:18:50 Job still running ...
2023/04/26 03:19:21 Job still running ...
2023/04/26 03:19:51 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-25_20_11_19-6183998804811155181 failed
--- FAIL: TestXLang_Partition (552.35s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2912.818s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682476312962265422
--- FAIL: TestBigQueryIO_BasicWriteRead (5.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32845 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kCIWeKHjrp" is_bounded:BOUNDED windowing_strategy_id:"w0@kCIWeKHjrp"}} windowing_strategies:{key:"w0@kCIWeKHjrp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kCIWeKHjrp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kCIWeKHjrp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kCIWeKHjrp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682476312962265422\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kCIWeKHjrp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32845 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kCIWeKHjrp" is_bounded:BOUNDED windowing_strategy_id:"w0@kCIWeKHjrp"}} windowing_strategies:{key:"w0@kCIWeKHjrp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kCIWeKHjrp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kCIWeKHjrp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kCIWeKHjrp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682476312962265422\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kCIWeKHjrp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc00059cb40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc00059cb40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000620080?, 0xc000590050?}, {0x11c3bf0, 0x39}, {0xc0001580c0?, 0x10c3940?, 0xc00061a0c0?}, {0xc000045f50, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000620020?, 0xc000590050?}, {0xc000050900, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc000050900, 0x52}, {0xf20680, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006031e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006031e0, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.633s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f96aee9917e4c5a00d6f06eb542bec24b44afc28f714a7a102c3eb5afc98cff0
Associated tags:
- 20230426-023116
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-023116
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230426-023116].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f96aee9917e4c5a00d6f06eb542bec24b44afc28f714a7a102c3eb5afc98cff0].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426022045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0602c7c37a898f2ba3bfecca8b63378ade966c33d982ea9af49067f6bab0ccab]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230426022045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0602c7c37a898f2ba3bfecca8b63378ade966c33d982ea9af49067f6bab0ccab])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0602c7c37a898f2ba3bfecca8b63378ade966c33d982ea9af49067f6bab0ccab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0602c7c37a898f2ba3bfecca8b63378ade966c33d982ea9af49067f6bab0ccab].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426022045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a22279983f9dde055b161ae7f513b391d2f4f77c91e1ef6202e83e1c6c21da]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230426022045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a22279983f9dde055b161ae7f513b391d2f4f77c91e1ef6202e83e1c6c21da])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a22279983f9dde055b161ae7f513b391d2f4f77c91e1ef6202e83e1c6c21da
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3a22279983f9dde055b161ae7f513b391d2f4f77c91e1ef6202e83e1c6c21da].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/weydp4jclzfs6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1570
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1570/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425202048",
"environmentId": "mKJUIAZpsNbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-203220"
}
]
},
"name": "go-testxlang_partition-22",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/25 21:18:39 Submitted job: 2023-04-25_14_18_38-16653064765621218636
2023/04/25 21:18:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-25_14_18_38-16653064765621218636?project=apache-beam-testing
2023/04/25 21:18:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-25_14_18_38-16653064765621218636
2023/04/25 21:18:39 Job state: JOB_STATE_PENDING ...
2023/04/25 21:19:09 Job still running ...
2023/04/25 21:19:39 Job still running ...
2023/04/25 21:20:09 Job still running ...
2023/04/25 21:20:39 Job still running ...
2023/04/25 21:21:09 Job still running ...
2023/04/25 21:21:39 Job still running ...
2023/04/25 21:22:09 Job still running ...
2023/04/25 21:22:39 Job still running ...
2023/04/25 21:23:09 Job still running ...
2023/04/25 21:23:39 Job still running ...
2023/04/25 21:24:09 Job still running ...
2023/04/25 21:24:39 Job still running ...
2023/04/25 21:25:10 Job still running ...
2023/04/25 21:25:40 Job still running ...
2023/04/25 21:26:10 Job still running ...
2023/04/25 21:26:40 Job still running ...
2023/04/25 21:27:10 Job still running ...
2023/04/25 21:27:40 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-25_14_18_38-16653064765621218636 failed
--- FAIL: TestXLang_Partition (582.71s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3314.622s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682454780471854779
--- FAIL: TestBigQueryIO_BasicWriteRead (5.99s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39755 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KJTNFqAxOb" is_bounded:BOUNDED windowing_strategy_id:"w0@KJTNFqAxOb"}} windowing_strategies:{key:"w0@KJTNFqAxOb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KJTNFqAxOb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KJTNFqAxOb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KJTNFqAxOb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682454780471854779\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KJTNFqAxOb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39755 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KJTNFqAxOb" is_bounded:BOUNDED windowing_strategy_id:"w0@KJTNFqAxOb"}} windowing_strategies:{key:"w0@KJTNFqAxOb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KJTNFqAxOb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KJTNFqAxOb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KJTNFqAxOb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682454780471854779\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KJTNFqAxOb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc0001ec400})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc0001ec400})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000322080?, 0xc0000c4050?}, {0x11c3bf0, 0x39}, {0xc0001580c0?, 0x10c3940?, 0xc0004fc0c0?}, {0xc000489f50, 0xf}, 0xc00019fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000322020?, 0xc0000c4050?}, {0xc00010ec60, 0x52}, {0x1?}, {0xc00019fea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f50, 0xf}, {0xc00010ec60, 0x52}, {0xf20680, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000500680)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000500680, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.011s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.036s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-203220
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-203220
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0dfa8a1f9f7c9619b5873e8740753a2741f3c657235497a465e3685219c6315f
Deleted: sha256:99ff198b9a68d5fd00e18daf5b20ea001a4e7e658027023ba5f09c594e25503d
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-203220
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0dfa8a1f9f7c9619b5873e8740753a2741f3c657235497a465e3685219c6315f
Associated tags:
- 20230425-203220
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-203220
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-203220].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0dfa8a1f9f7c9619b5873e8740753a2741f3c657235497a465e3685219c6315f].
$ rm -rf /tmp/tmp.jOk3VsHrfX
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425202048
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f4458cb37d18dc58f7a0b3d97fdfcaedba138ba54cc00069ead95c3884f8fa8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425202048]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f4458cb37d18dc58f7a0b3d97fdfcaedba138ba54cc00069ead95c3884f8fa8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425202048] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f4458cb37d18dc58f7a0b3d97fdfcaedba138ba54cc00069ead95c3884f8fa8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f4458cb37d18dc58f7a0b3d97fdfcaedba138ba54cc00069ead95c3884f8fa8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f4458cb37d18dc58f7a0b3d97fdfcaedba138ba54cc00069ead95c3884f8fa8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f4458cb37d18dc58f7a0b3d97fdfcaedba138ba54cc00069ead95c3884f8fa8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425202048
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5cc35d734d7076691b6d35a955475f58bf616f9f01484ad6d876894e87846a44
Deleted: sha256:87796ddf3ee1d010596fee26d3b739b4f7ca12e7e6e43f352c808265cfecf91f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425202048]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5cc35d734d7076691b6d35a955475f58bf616f9f01484ad6d876894e87846a44]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425202048] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5cc35d734d7076691b6d35a955475f58bf616f9f01484ad6d876894e87846a44])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5cc35d734d7076691b6d35a955475f58bf616f9f01484ad6d876894e87846a44
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5cc35d734d7076691b6d35a955475f58bf616f9f01484ad6d876894e87846a44
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5cc35d734d7076691b6d35a955475f58bf616f9f01484ad6d876894e87846a44].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2380109.
Stopping expansion service pid: 2380110.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 55s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/4sdm67xxpsorm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1569
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1569/display/redirect?page=changes>
Changes:
[noreply] [AWS2] Bump AWS v2 SDK (closes #26323) (#26380)
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425142053",
"environmentId": "NFHzybyJdzbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-143400"
}
]
},
"name": "go-testxlang_partition-737",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/25 15:22:19 Submitted job: 2023-04-25_08_22_18-17786775166547492800
2023/04/25 15:22:19 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-25_08_22_18-17786775166547492800?project=apache-beam-testing
2023/04/25 15:22:19 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-25_08_22_18-17786775166547492800
2023/04/25 15:22:19 Job state: JOB_STATE_PENDING ...
2023/04/25 15:22:49 Job still running ...
2023/04/25 15:23:19 Job still running ...
2023/04/25 15:23:49 Job still running ...
2023/04/25 15:24:19 Job still running ...
2023/04/25 15:24:49 Job still running ...
2023/04/25 15:25:19 Job still running ...
2023/04/25 15:25:49 Job still running ...
2023/04/25 15:26:19 Job still running ...
2023/04/25 15:26:49 Job still running ...
2023/04/25 15:27:19 Job still running ...
2023/04/25 15:27:49 Job still running ...
2023/04/25 15:28:19 Job still running ...
2023/04/25 15:28:49 Job still running ...
2023/04/25 15:29:19 Job still running ...
2023/04/25 15:29:49 Job still running ...
2023/04/25 15:30:19 Job still running ...
2023/04/25 15:30:50 Job still running ...
2023/04/25 15:31:20 Job still running ...
2023/04/25 15:31:50 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-25_08_22_18-17786775166547492800 failed
--- FAIL: TestXLang_Partition (612.31s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3462.565s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682433282357098944
--- FAIL: TestBigQueryIO_BasicWriteRead (5.98s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45113 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jLyKQyLyss" is_bounded:BOUNDED windowing_strategy_id:"w0@jLyKQyLyss"}} windowing_strategies:{key:"w0@jLyKQyLyss" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jLyKQyLyss" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jLyKQyLyss" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jLyKQyLyss" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682433282357098944\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jLyKQyLyss"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45113 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jLyKQyLyss" is_bounded:BOUNDED windowing_strategy_id:"w0@jLyKQyLyss"}} windowing_strategies:{key:"w0@jLyKQyLyss" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jLyKQyLyss" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jLyKQyLyss" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jLyKQyLyss" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682433282357098944\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jLyKQyLyss"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 5 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc000140500})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc000140500})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001e21c0?, 0xc000180280?}, {0x11c3bf0, 0x39}, {0xc0001d00c0?, 0x10c3940?, 0xc0006560c0?}, {0xc000650e50, 0xf}, 0xc0000ebd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0001e20a0?, 0xc000180280?}, {0xc000182c60, 0x52}, {0x1?}, {0xc0000ebea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000650e50, 0xf}, {0xc000182c60, 0x52}, {0xf20680, 0xc0001a8078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000102d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000102d00, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.029s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.055s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30f909998e51cb862571d822315a794e4465069dbd8d5e4ed81f8b04bcd91ac9
Associated tags:
- 20230425-143400
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-143400
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-143400].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:30f909998e51cb862571d822315a794e4465069dbd8d5e4ed81f8b04bcd91ac9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425142053]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:84ca16d57308e2306000d5a1269cec92bdd7a6f96ebdd0976996ce7b4dfa5113]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425142053] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:84ca16d57308e2306000d5a1269cec92bdd7a6f96ebdd0976996ce7b4dfa5113])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:84ca16d57308e2306000d5a1269cec92bdd7a6f96ebdd0976996ce7b4dfa5113
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:84ca16d57308e2306000d5a1269cec92bdd7a6f96ebdd0976996ce7b4dfa5113].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425142053]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dde21f2a363f04a2dc30b45421ef93ac62a5fc99ac7c34f7387e5156eb7c3830]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425142053] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dde21f2a363f04a2dc30b45421ef93ac62a5fc99ac7c34f7387e5156eb7c3830])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dde21f2a363f04a2dc30b45421ef93ac62a5fc99ac7c34f7387e5156eb7c3830
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dde21f2a363f04a2dc30b45421ef93ac62a5fc99ac7c34f7387e5156eb7c3830].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 12m
232 actionable tasks: 160 executed, 60 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/g2jujshlgasqs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1568
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1568/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425082033",
"environmentId": "pWwLBPxWrObeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-083114"
}
]
},
"name": "go-testxlang_partition-610",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/25 09:17:28 Submitted job: 2023-04-25_02_17_27-8515233007656603748
2023/04/25 09:17:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-25_02_17_27-8515233007656603748?project=apache-beam-testing
2023/04/25 09:17:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-25_02_17_27-8515233007656603748
2023/04/25 09:17:28 Job state: JOB_STATE_PENDING ...
2023/04/25 09:17:58 Job still running ...
2023/04/25 09:18:28 Job still running ...
2023/04/25 09:18:58 Job still running ...
2023/04/25 09:19:28 Job still running ...
2023/04/25 09:19:58 Job still running ...
2023/04/25 09:20:28 Job still running ...
2023/04/25 09:20:58 Job still running ...
2023/04/25 09:21:28 Job still running ...
2023/04/25 09:21:58 Job still running ...
2023/04/25 09:22:28 Job still running ...
2023/04/25 09:22:59 Job still running ...
2023/04/25 09:23:29 Job still running ...
2023/04/25 09:23:59 Job still running ...
2023/04/25 09:24:29 Job still running ...
2023/04/25 09:24:59 Job still running ...
2023/04/25 09:25:29 Job still running ...
2023/04/25 09:25:59 Job still running ...
2023/04/25 09:26:29 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-25_02_17_27-8515233007656603748 failed
--- FAIL: TestXLang_Partition (581.35s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3313.433s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682411510130078664
--- FAIL: TestBigQueryIO_BasicWriteRead (5.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37909 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xbepHEgSyG" is_bounded:BOUNDED windowing_strategy_id:"w0@xbepHEgSyG"}} windowing_strategies:{key:"w0@xbepHEgSyG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xbepHEgSyG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xbepHEgSyG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xbepHEgSyG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682411510130078664\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xbepHEgSyG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37909 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xbepHEgSyG" is_bounded:BOUNDED windowing_strategy_id:"w0@xbepHEgSyG"}} windowing_strategies:{key:"w0@xbepHEgSyG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xbepHEgSyG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xbepHEgSyG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xbepHEgSyG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682411510130078664\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xbepHEgSyG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc0003bc500})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc0003bc500})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae9a0?, 0xc00071a3c0?}, {0x11c3bf0, 0x39}, {0xc0000f6180?, 0x10c3940?, 0xc00054af00?}, {0xc00046de10, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae4e0?, 0xc00071a3c0?}, {0xc000050e40, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050e40, 0x52}, {0xf20680, 0xc0005a51a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103a00, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.676s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-083114
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-083114
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7acb33ea99335e371809e70f82b1eb0505a9928e487c8e2c5896a571864813e7
Deleted: sha256:c72e0e8bf3cbdb90d5fc9251b19c4285a30e22a413cac939a9778e66230a95f8
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-083114
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7acb33ea99335e371809e70f82b1eb0505a9928e487c8e2c5896a571864813e7
Associated tags:
- 20230425-083114
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-083114
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-083114].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7acb33ea99335e371809e70f82b1eb0505a9928e487c8e2c5896a571864813e7].
$ rm -rf /tmp/tmp.ZBiGhaAWQV
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425082033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fef21ab9d268d90540ec2a856f466e564840c240d85fbbbd2444754f5f1811e9
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425082033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fef21ab9d268d90540ec2a856f466e564840c240d85fbbbd2444754f5f1811e9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425082033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fef21ab9d268d90540ec2a856f466e564840c240d85fbbbd2444754f5f1811e9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fef21ab9d268d90540ec2a856f466e564840c240d85fbbbd2444754f5f1811e9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fef21ab9d268d90540ec2a856f466e564840c240d85fbbbd2444754f5f1811e9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fef21ab9d268d90540ec2a856f466e564840c240d85fbbbd2444754f5f1811e9].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425082033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56aad49ad1153280e64707740dad7872ae190ed0908da60533ce981722156e10
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425082033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56aad49ad1153280e64707740dad7872ae190ed0908da60533ce981722156e10]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425082033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56aad49ad1153280e64707740dad7872ae190ed0908da60533ce981722156e10])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56aad49ad1153280e64707740dad7872ae190ed0908da60533ce981722156e10
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56aad49ad1153280e64707740dad7872ae190ed0908da60533ce981722156e10
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56aad49ad1153280e64707740dad7872ae190ed0908da60533ce981722156e10].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 44113.
Stopping expansion service pid: 44114.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 52s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/cjxtm5hvvboqi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1567
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1567/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425022042",
"environmentId": "xvgrWScXiTbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-023203"
}
]
},
"name": "go-testxlang_partition-644",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/25 03:18:37 Submitted job: 2023-04-24_20_18_37-13311121686347574483
2023/04/25 03:18:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-24_20_18_37-13311121686347574483?project=apache-beam-testing
2023/04/25 03:18:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-24_20_18_37-13311121686347574483
2023/04/25 03:18:37 Job state: JOB_STATE_PENDING ...
2023/04/25 03:19:07 Job still running ...
2023/04/25 03:19:37 Job still running ...
2023/04/25 03:20:07 Job still running ...
2023/04/25 03:20:37 Job still running ...
2023/04/25 03:21:07 Job still running ...
2023/04/25 03:21:37 Job still running ...
2023/04/25 03:22:08 Job still running ...
2023/04/25 03:22:38 Job still running ...
2023/04/25 03:23:08 Job still running ...
2023/04/25 03:23:38 Job still running ...
2023/04/25 03:24:08 Job still running ...
2023/04/25 03:24:38 Job still running ...
2023/04/25 03:25:08 Job still running ...
2023/04/25 03:25:38 Job still running ...
2023/04/25 03:26:08 Job still running ...
2023/04/25 03:26:38 Job still running ...
2023/04/25 03:27:08 Job still running ...
2023/04/25 03:27:38 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-24_20_18_37-13311121686347574483 failed
--- FAIL: TestXLang_Partition (580.51s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3331.343s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682389965018372923
--- FAIL: TestBigQueryIO_BasicWriteRead (6.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35981 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XjIXxdLsCz" is_bounded:BOUNDED windowing_strategy_id:"w0@XjIXxdLsCz"}} windowing_strategies:{key:"w0@XjIXxdLsCz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XjIXxdLsCz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XjIXxdLsCz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XjIXxdLsCz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682389965018372923\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XjIXxdLsCz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35981 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XjIXxdLsCz" is_bounded:BOUNDED windowing_strategy_id:"w0@XjIXxdLsCz"}} windowing_strategies:{key:"w0@XjIXxdLsCz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XjIXxdLsCz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XjIXxdLsCz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XjIXxdLsCz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682389965018372923\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XjIXxdLsCz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc000444700})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc000444700})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000674fc0?, 0xc0001362d0?}, {0x11c3bf0, 0x39}, {0xc0001580c0?, 0x10c3940?, 0xc000284de0?}, {0xc000045f50, 0xf}, 0xc00028fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000674f60?, 0xc0001362d0?}, {0xc00010eba0, 0x52}, {0x1?}, {0xc00028fea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc00010eba0, 0x52}, {0xf20680, 0xc000489340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503520, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.351s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.037s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-023203
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-023203
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:57838f56d8f55700b173f2362f5f771a0703c9356f6523414dfc1efb230428d3
Deleted: sha256:76f96942aebea33d6ccd6b740bc2e7f04e9ec05a2733be2e7206ece562ffeb54
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-023203
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:57838f56d8f55700b173f2362f5f771a0703c9356f6523414dfc1efb230428d3
Associated tags:
- 20230425-023203
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-023203
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230425-023203].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:57838f56d8f55700b173f2362f5f771a0703c9356f6523414dfc1efb230428d3].
$ rm -rf /tmp/tmp.1fDqPHGAfN
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425022042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0dfde3ea02e555c5dead91bf70d20ad042ba4a2a5c41ae82957f858e7a913bef
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0dfde3ea02e555c5dead91bf70d20ad042ba4a2a5c41ae82957f858e7a913bef]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230425022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0dfde3ea02e555c5dead91bf70d20ad042ba4a2a5c41ae82957f858e7a913bef])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0dfde3ea02e555c5dead91bf70d20ad042ba4a2a5c41ae82957f858e7a913bef
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0dfde3ea02e555c5dead91bf70d20ad042ba4a2a5c41ae82957f858e7a913bef
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0dfde3ea02e555c5dead91bf70d20ad042ba4a2a5c41ae82957f858e7a913bef].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425022042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6f13436ad8c9b417fcde5a667664fffe7032abc66e1779881ba204342d111a07
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6f13436ad8c9b417fcde5a667664fffe7032abc66e1779881ba204342d111a07]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230425022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6f13436ad8c9b417fcde5a667664fffe7032abc66e1779881ba204342d111a07])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6f13436ad8c9b417fcde5a667664fffe7032abc66e1779881ba204342d111a07
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6f13436ad8c9b417fcde5a667664fffe7032abc66e1779881ba204342d111a07
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6f13436ad8c9b417fcde5a667664fffe7032abc66e1779881ba204342d111a07].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3810303.
Stopping expansion service pid: 3810304.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 52s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/l2uzvmx3krj6e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1566
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1566/display/redirect?page=changes>
Changes:
[noreply] Allow multi_process_shared objects to be called (#26202)
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424202031",
"environmentId": "qhnJppZtsMbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-203206"
}
]
},
"name": "go-testxlang_partition-312",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/24 21:18:16 Submitted job: 2023-04-24_14_18_15-4422109541127213251
2023/04/24 21:18:16 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-24_14_18_15-4422109541127213251?project=apache-beam-testing
2023/04/24 21:18:16 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-24_14_18_15-4422109541127213251
2023/04/24 21:18:16 Job state: JOB_STATE_PENDING ...
2023/04/24 21:18:46 Job still running ...
2023/04/24 21:19:16 Job still running ...
2023/04/24 21:19:46 Job still running ...
2023/04/24 21:20:16 Job still running ...
2023/04/24 21:20:46 Job still running ...
2023/04/24 21:21:16 Job still running ...
2023/04/24 21:21:46 Job still running ...
2023/04/24 21:22:16 Job still running ...
2023/04/24 21:22:46 Job still running ...
2023/04/24 21:23:16 Job still running ...
2023/04/24 21:23:46 Job still running ...
2023/04/24 21:24:16 Job still running ...
2023/04/24 21:24:46 Job still running ...
2023/04/24 21:25:16 Job still running ...
2023/04/24 21:25:46 Job still running ...
2023/04/24 21:26:16 Job still running ...
2023/04/24 21:26:46 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-24_14_18_15-4422109541127213251 failed
--- FAIL: TestXLang_Partition (550.27s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3276.112s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682368368498337961
--- FAIL: TestBigQueryIO_BasicWriteRead (6.79s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42811 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PUfSCjZZnE" is_bounded:BOUNDED windowing_strategy_id:"w0@PUfSCjZZnE"}} windowing_strategies:{key:"w0@PUfSCjZZnE" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PUfSCjZZnE" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PUfSCjZZnE" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PUfSCjZZnE" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682368368498337961\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PUfSCjZZnE"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42811 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PUfSCjZZnE" is_bounded:BOUNDED windowing_strategy_id:"w0@PUfSCjZZnE"}} windowing_strategies:{key:"w0@PUfSCjZZnE" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PUfSCjZZnE" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PUfSCjZZnE" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PUfSCjZZnE" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682368368498337961\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PUfSCjZZnE"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 28 [running]:
testing.tRunner.func1.2({0xfdbb60, 0xc00064f0c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdbb60, 0xc00064f0c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000d8080?, 0xc000136230?}, {0x11c3bf0, 0x39}, {0xc0001580c0?, 0x10c3940?, 0xc0000d20c0?}, {0xc000045f40, 0xf}, 0xc0002d7d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000d8020?, 0xc000136230?}, {0xc000050900, 0x52}, {0x1?}, {0xc0002d7ea8, 0x2, 0xedbbe0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc000050900, 0x52}, {0xf20680, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503520, 0x11f6a28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.814s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-203206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-203206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8918666bfeb3a105f31ac51b2dfd20d4051088eb4f8df80835ec70b2e5db843d
Deleted: sha256:19bd6f33b5eabc5909296144b3372c8ec8aa947f5f53a25a3955bf3bb8450670
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-203206
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8918666bfeb3a105f31ac51b2dfd20d4051088eb4f8df80835ec70b2e5db843d
Associated tags:
- 20230424-203206
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-203206
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-203206].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8918666bfeb3a105f31ac51b2dfd20d4051088eb4f8df80835ec70b2e5db843d].
$ rm -rf /tmp/tmp.5S9M7JjtY6
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424202031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46750385b6afcca8aa68bb63a03924519a76be568c902d688c8cdecab23d45d7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46750385b6afcca8aa68bb63a03924519a76be568c902d688c8cdecab23d45d7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46750385b6afcca8aa68bb63a03924519a76be568c902d688c8cdecab23d45d7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46750385b6afcca8aa68bb63a03924519a76be568c902d688c8cdecab23d45d7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46750385b6afcca8aa68bb63a03924519a76be568c902d688c8cdecab23d45d7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:46750385b6afcca8aa68bb63a03924519a76be568c902d688c8cdecab23d45d7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424202031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90773dd45e42cb2215952da63887b58ce16eadff691a90404ada4ec5b50baf61
Deleted: sha256:489c8223fe89bf8de8e9c96093cc79e4a841d8f354052eee228158ee3eacb2eb
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90773dd45e42cb2215952da63887b58ce16eadff691a90404ada4ec5b50baf61]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90773dd45e42cb2215952da63887b58ce16eadff691a90404ada4ec5b50baf61])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90773dd45e42cb2215952da63887b58ce16eadff691a90404ada4ec5b50baf61
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90773dd45e42cb2215952da63887b58ce16eadff691a90404ada4ec5b50baf61
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90773dd45e42cb2215952da63887b58ce16eadff691a90404ada4ec5b50baf61].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 348845.
Stopping expansion service pid: 348846.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 15s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/g5gt72zvtq7pw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1565
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1565/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424142045",
"environmentId": "cgQpaAikSybeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-143154"
}
]
},
"name": "go-testxlang_partition-614",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/24 15:16:56 Submitted job: 2023-04-24_08_16_56-12577408110751602293
2023/04/24 15:16:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-24_08_16_56-12577408110751602293?project=apache-beam-testing
2023/04/24 15:16:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-24_08_16_56-12577408110751602293
2023/04/24 15:16:56 Job state: JOB_STATE_PENDING ...
2023/04/24 15:17:26 Job still running ...
2023/04/24 15:17:56 Job still running ...
2023/04/24 15:18:26 Job still running ...
2023/04/24 15:18:56 Job still running ...
2023/04/24 15:19:26 Job still running ...
2023/04/24 15:19:56 Job still running ...
2023/04/24 15:20:26 Job still running ...
2023/04/24 15:20:56 Job still running ...
2023/04/24 15:21:26 Job still running ...
2023/04/24 15:21:56 Job still running ...
2023/04/24 15:22:26 Job still running ...
2023/04/24 15:22:56 Job still running ...
2023/04/24 15:23:27 Job still running ...
2023/04/24 15:23:57 Job still running ...
2023/04/24 15:24:27 Job still running ...
2023/04/24 15:24:57 Job still running ...
2023/04/24 15:25:27 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-24_08_16_56-12577408110751602293 failed
--- FAIL: TestXLang_Partition (550.22s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3209.908s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682346751480066777
--- FAIL: TestBigQueryIO_BasicWriteRead (5.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36143 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kcNEoYXHfi" is_bounded:BOUNDED windowing_strategy_id:"w0@kcNEoYXHfi"}} windowing_strategies:{key:"w0@kcNEoYXHfi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kcNEoYXHfi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kcNEoYXHfi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kcNEoYXHfi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682346751480066777\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kcNEoYXHfi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36143 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kcNEoYXHfi" is_bounded:BOUNDED windowing_strategy_id:"w0@kcNEoYXHfi"}} windowing_strategies:{key:"w0@kcNEoYXHfi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kcNEoYXHfi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kcNEoYXHfi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kcNEoYXHfi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682346751480066777\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kcNEoYXHfi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0005b6400})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0005b6400})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006e80c0?, 0xc00020c000?}, {0x11c4b90, 0x39}, {0xc000282000?, 0x10c4a20?, 0xc0002020c0?}, {0xc00046de10, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006e8060?, 0xc00020c000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050e40, 0x52}, {0xf21660, 0xc0006d8088})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103520, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.636s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.058s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-143154
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-143154
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7fb82f7dd0610b935fe27186c17db6c55336d10eeae2f4de20906647893d76c7
Deleted: sha256:e78109f27f786ef5b2bb02dea5e7aa743dca37813a3a13d7ddfba22dab3b4eb3
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-143154
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7fb82f7dd0610b935fe27186c17db6c55336d10eeae2f4de20906647893d76c7
Associated tags:
- 20230424-143154
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-143154
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-143154].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7fb82f7dd0610b935fe27186c17db6c55336d10eeae2f4de20906647893d76c7].
$ rm -rf /tmp/tmp.5cZ5IyoVKf
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424142045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:37946af65ec5dc9a1e5b6b17382fd68dddb3840c09692e023e1bc8a28606de1d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424142045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:37946af65ec5dc9a1e5b6b17382fd68dddb3840c09692e023e1bc8a28606de1d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424142045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:37946af65ec5dc9a1e5b6b17382fd68dddb3840c09692e023e1bc8a28606de1d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:37946af65ec5dc9a1e5b6b17382fd68dddb3840c09692e023e1bc8a28606de1d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:37946af65ec5dc9a1e5b6b17382fd68dddb3840c09692e023e1bc8a28606de1d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:37946af65ec5dc9a1e5b6b17382fd68dddb3840c09692e023e1bc8a28606de1d].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424142045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b1e233a963e00ad180ec21d41d7de73e07432ef6803cb183b5086444be099
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424142045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b1e233a963e00ad180ec21d41d7de73e07432ef6803cb183b5086444be099]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424142045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b1e233a963e00ad180ec21d41d7de73e07432ef6803cb183b5086444be099])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b1e233a963e00ad180ec21d41d7de73e07432ef6803cb183b5086444be099
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b1e233a963e00ad180ec21d41d7de73e07432ef6803cb183b5086444be099
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b1e233a963e00ad180ec21d41d7de73e07432ef6803cb183b5086444be099].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4127706.
Stopping expansion service pid: 4127707.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 41s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/aizijet5zjejo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1564
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1564/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424082116",
"environmentId": "eXcELElVbmbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-083238"
}
]
},
"name": "go-testxlang_partition-639",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/24 09:11:55 Submitted job: 2023-04-24_02_11_54-17393585514725952713
2023/04/24 09:11:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-24_02_11_54-17393585514725952713?project=apache-beam-testing
2023/04/24 09:11:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-24_02_11_54-17393585514725952713
2023/04/24 09:11:55 Job state: JOB_STATE_PENDING ...
2023/04/24 09:12:25 Job still running ...
2023/04/24 09:12:55 Job still running ...
2023/04/24 09:13:25 Job still running ...
2023/04/24 09:13:55 Job still running ...
2023/04/24 09:14:25 Job still running ...
2023/04/24 09:14:55 Job still running ...
2023/04/24 09:15:25 Job still running ...
2023/04/24 09:15:55 Job still running ...
2023/04/24 09:16:25 Job still running ...
2023/04/24 09:16:55 Job still running ...
2023/04/24 09:17:25 Job still running ...
2023/04/24 09:17:55 Job still running ...
2023/04/24 09:18:25 Job still running ...
2023/04/24 09:18:55 Job still running ...
2023/04/24 09:19:25 Job still running ...
2023/04/24 09:19:55 Job still running ...
2023/04/24 09:20:25 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-24_02_11_54-17393585514725952713 failed
--- FAIL: TestXLang_Partition (550.70s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2863.202s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682325196885098685
--- FAIL: TestBigQueryIO_BasicWriteRead (5.20s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34825 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@utHqZTUwBF" is_bounded:BOUNDED windowing_strategy_id:"w0@utHqZTUwBF"}} windowing_strategies:{key:"w0@utHqZTUwBF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@utHqZTUwBF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@utHqZTUwBF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@utHqZTUwBF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682325196885098685\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"utHqZTUwBF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34825 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@utHqZTUwBF" is_bounded:BOUNDED windowing_strategy_id:"w0@utHqZTUwBF"}} windowing_strategies:{key:"w0@utHqZTUwBF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@utHqZTUwBF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@utHqZTUwBF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@utHqZTUwBF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682325196885098685\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"utHqZTUwBF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 51 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc00039a700})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc00039a700})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001cefc0?, 0xc00062a0f0?}, {0x11c4b90, 0x39}, {0xc0001d00c0?, 0x10c4a20?, 0xc000266f60?}, {0xc0004fff80, 0xf}, 0xc000305d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0001cef60?, 0xc00062a0f0?}, {0xc000632840, 0x52}, {0x1?}, {0xc000305ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0004fff80, 0xf}, {0xc000632840, 0x52}, {0xf21660, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103d40, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.229s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.042s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-083238
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-083238
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:54bc7227453fb9ef28e1ba59c0169179ae824dd319ae9413ccbefba7f81c4279
Deleted: sha256:4d91b5ca08637ad74b94892decf4ee6bc0043b66d364ba68194e20806c183339
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-083238
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:54bc7227453fb9ef28e1ba59c0169179ae824dd319ae9413ccbefba7f81c4279
Associated tags:
- 20230424-083238
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-083238
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-083238].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:54bc7227453fb9ef28e1ba59c0169179ae824dd319ae9413ccbefba7f81c4279].
$ rm -rf /tmp/tmp.XMZi3qFJth
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424082116
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfa09e359015e4926bd0fc17661f8589899572a77a8ef438d9196630e9fc9d86
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424082116]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfa09e359015e4926bd0fc17661f8589899572a77a8ef438d9196630e9fc9d86]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424082116] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfa09e359015e4926bd0fc17661f8589899572a77a8ef438d9196630e9fc9d86])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfa09e359015e4926bd0fc17661f8589899572a77a8ef438d9196630e9fc9d86
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfa09e359015e4926bd0fc17661f8589899572a77a8ef438d9196630e9fc9d86
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:bfa09e359015e4926bd0fc17661f8589899572a77a8ef438d9196630e9fc9d86].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424082116
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ae19bd3d6b7f027b94e9af45ab81c198032ff7bebd182feb1a24d09acc341d7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424082116]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ae19bd3d6b7f027b94e9af45ab81c198032ff7bebd182feb1a24d09acc341d7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424082116] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ae19bd3d6b7f027b94e9af45ab81c198032ff7bebd182feb1a24d09acc341d7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ae19bd3d6b7f027b94e9af45ab81c198032ff7bebd182feb1a24d09acc341d7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ae19bd3d6b7f027b94e9af45ab81c198032ff7bebd182feb1a24d09acc341d7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ae19bd3d6b7f027b94e9af45ab81c198032ff7bebd182feb1a24d09acc341d7].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1552473.
Stopping expansion service pid: 1552474.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 35s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/r6y5mqrujcdxk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1563
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1563/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424022034",
"environmentId": "epwzzNNPcFbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-023201"
}
]
},
"name": "go-testxlang_partition-922",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/24 03:15:36 Submitted job: 2023-04-23_20_15_36-11479676434227410213
2023/04/24 03:15:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-23_20_15_36-11479676434227410213?project=apache-beam-testing
2023/04/24 03:15:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-23_20_15_36-11479676434227410213
2023/04/24 03:15:36 Job state: JOB_STATE_PENDING ...
2023/04/24 03:16:06 Job still running ...
2023/04/24 03:16:37 Job still running ...
2023/04/24 03:17:07 Job still running ...
2023/04/24 03:17:37 Job still running ...
2023/04/24 03:18:07 Job still running ...
2023/04/24 03:18:37 Job still running ...
2023/04/24 03:19:07 Job still running ...
2023/04/24 03:19:37 Job still running ...
2023/04/24 03:20:07 Job still running ...
2023/04/24 03:20:37 Job still running ...
2023/04/24 03:21:07 Job still running ...
2023/04/24 03:21:37 Job still running ...
2023/04/24 03:22:07 Job still running ...
2023/04/24 03:22:37 Job still running ...
2023/04/24 03:23:07 Job still running ...
2023/04/24 03:23:37 Job still running ...
2023/04/24 03:24:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-23_20_15_36-11479676434227410213 failed
--- FAIL: TestXLang_Partition (550.61s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3119.540s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682303562490568388
--- FAIL: TestBigQueryIO_BasicWriteRead (5.86s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34585 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JmWCBfHcoU" is_bounded:BOUNDED windowing_strategy_id:"w0@JmWCBfHcoU"}} windowing_strategies:{key:"w0@JmWCBfHcoU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JmWCBfHcoU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JmWCBfHcoU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JmWCBfHcoU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682303562490568388\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JmWCBfHcoU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34585 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@JmWCBfHcoU" is_bounded:BOUNDED windowing_strategy_id:"w0@JmWCBfHcoU"}} windowing_strategies:{key:"w0@JmWCBfHcoU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@JmWCBfHcoU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@JmWCBfHcoU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@JmWCBfHcoU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682303562490568388\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"JmWCBfHcoU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc000404b00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc000404b00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006800a0?, 0xc000136230?}, {0x11c4b90, 0x39}, {0xc0001580c0?, 0x10c4a20?, 0xc0004ec0c0?}, {0xc000487f80, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000680040?, 0xc000136230?}, {0xc00053e840, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000487f80, 0xf}, {0xc00053e840, 0x52}, {0xf21660, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503d40, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.890s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:78926ee9e8ef3fbfdf9bf6c9221ac71c67ab2c54252f166aee6e044dc04c8723
Associated tags:
- 20230424-023201
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-023201
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230424-023201].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:78926ee9e8ef3fbfdf9bf6c9221ac71c67ab2c54252f166aee6e044dc04c8723].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424022034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d189074c5cdfaddfeba6510e85fcf2be19b725700d310bcc189f72a14317e573]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230424022034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d189074c5cdfaddfeba6510e85fcf2be19b725700d310bcc189f72a14317e573])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d189074c5cdfaddfeba6510e85fcf2be19b725700d310bcc189f72a14317e573
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d189074c5cdfaddfeba6510e85fcf2be19b725700d310bcc189f72a14317e573].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424022034]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9afb71c20b7806ae5011fa5e1b5202be0f79a9af7107a6c2d4857157992dca1d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230424022034] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9afb71c20b7806ae5011fa5e1b5202be0f79a9af7107a6c2d4857157992dca1d])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9afb71c20b7806ae5011fa5e1b5202be0f79a9af7107a6c2d4857157992dca1d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9afb71c20b7806ae5011fa5e1b5202be0f79a9af7107a6c2d4857157992dca1d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 31s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/bahyecarpm47u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1562
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1562/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423202030",
"environmentId": "eFWTUagSeAbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-203123"
}
]
},
"name": "go-testxlang_partition-297",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/23 21:14:53 Submitted job: 2023-04-23_14_14_52-8489551895907476616
2023/04/23 21:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-23_14_14_52-8489551895907476616?project=apache-beam-testing
2023/04/23 21:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-23_14_14_52-8489551895907476616
2023/04/23 21:14:53 Job state: JOB_STATE_PENDING ...
2023/04/23 21:15:23 Job still running ...
2023/04/23 21:15:53 Job still running ...
2023/04/23 21:16:23 Job still running ...
2023/04/23 21:16:53 Job still running ...
2023/04/23 21:17:23 Job still running ...
2023/04/23 21:17:53 Job still running ...
2023/04/23 21:18:23 Job still running ...
2023/04/23 21:18:53 Job still running ...
2023/04/23 21:19:23 Job still running ...
2023/04/23 21:19:53 Job still running ...
2023/04/23 21:20:23 Job still running ...
2023/04/23 21:20:53 Job still running ...
2023/04/23 21:21:23 Job still running ...
2023/04/23 21:21:53 Job still running ...
2023/04/23 21:22:23 Job still running ...
2023/04/23 21:22:54 Job still running ...
2023/04/23 21:23:24 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-23_14_14_52-8489551895907476616 failed
--- FAIL: TestXLang_Partition (550.58s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3116.712s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682281920762779637
--- FAIL: TestBigQueryIO_BasicWriteRead (4.91s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38389 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@iBMJuOlnIU" is_bounded:BOUNDED windowing_strategy_id:"w0@iBMJuOlnIU"}} windowing_strategies:{key:"w0@iBMJuOlnIU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@iBMJuOlnIU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@iBMJuOlnIU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@iBMJuOlnIU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682281920762779637\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"iBMJuOlnIU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38389 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@iBMJuOlnIU" is_bounded:BOUNDED windowing_strategy_id:"w0@iBMJuOlnIU"}} windowing_strategies:{key:"w0@iBMJuOlnIU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@iBMJuOlnIU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@iBMJuOlnIU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@iBMJuOlnIU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682281920762779637\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"iBMJuOlnIU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0005a2b80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0005a2b80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000334080?, 0xc000590050?}, {0x11c4b90, 0x39}, {0xc0001580c0?, 0x10c4a20?, 0xc00032c0c0?}, {0xc000045f50, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000334020?, 0xc000590050?}, {0xc000050900, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc000050900, 0x52}, {0xf21660, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031f6c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031f6c0, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.939s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-203123
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-203123
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:eeff98febd890026ef8245f3aef75f82007f7e9d71e75dd2ac8954445d61b42a
Deleted: sha256:3ad01601b56544579997c4a5b50e5706e1c6e1f5af76dbbe1f73df98714af0cc
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-203123
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:eeff98febd890026ef8245f3aef75f82007f7e9d71e75dd2ac8954445d61b42a
Associated tags:
- 20230423-203123
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-203123
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-203123].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:eeff98febd890026ef8245f3aef75f82007f7e9d71e75dd2ac8954445d61b42a].
$ rm -rf /tmp/tmp.gt12xIWLUL
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423202030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da9387e50406f00f88a7702a38aafc63f0c802910877d1d03b227bff5d5160b8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423202030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da9387e50406f00f88a7702a38aafc63f0c802910877d1d03b227bff5d5160b8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423202030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da9387e50406f00f88a7702a38aafc63f0c802910877d1d03b227bff5d5160b8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da9387e50406f00f88a7702a38aafc63f0c802910877d1d03b227bff5d5160b8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da9387e50406f00f88a7702a38aafc63f0c802910877d1d03b227bff5d5160b8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da9387e50406f00f88a7702a38aafc63f0c802910877d1d03b227bff5d5160b8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423202030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541e3fe1d7a114fe221f9e8c3e9a26d779ea6ffb528ed087d47d5fe85b082775
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423202030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541e3fe1d7a114fe221f9e8c3e9a26d779ea6ffb528ed087d47d5fe85b082775]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423202030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541e3fe1d7a114fe221f9e8c3e9a26d779ea6ffb528ed087d47d5fe85b082775])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541e3fe1d7a114fe221f9e8c3e9a26d779ea6ffb528ed087d47d5fe85b082775
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541e3fe1d7a114fe221f9e8c3e9a26d779ea6ffb528ed087d47d5fe85b082775
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:541e3fe1d7a114fe221f9e8c3e9a26d779ea6ffb528ed087d47d5fe85b082775].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 961516.
Stopping expansion service pid: 961517.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 50s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/6ei3nmvtvxqse
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1561
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1561/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423142029",
"environmentId": "SkBhKpxrHybeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-143113"
}
]
},
"name": "go-testxlang_partition-562",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/23 15:08:40 Submitted job: 2023-04-23_08_08_39-4415882098709145642
2023/04/23 15:08:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-23_08_08_39-4415882098709145642?project=apache-beam-testing
2023/04/23 15:08:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-23_08_08_39-4415882098709145642
2023/04/23 15:08:40 Job state: JOB_STATE_PENDING ...
2023/04/23 15:09:10 Job still running ...
2023/04/23 15:09:40 Job still running ...
2023/04/23 15:10:10 Job still running ...
2023/04/23 15:10:40 Job still running ...
2023/04/23 15:11:10 Job still running ...
2023/04/23 15:11:40 Job still running ...
2023/04/23 15:12:10 Job still running ...
2023/04/23 15:12:40 Job still running ...
2023/04/23 15:13:10 Job still running ...
2023/04/23 15:13:40 Job still running ...
2023/04/23 15:14:10 Job still running ...
2023/04/23 15:14:40 Job still running ...
2023/04/23 15:15:10 Job still running ...
2023/04/23 15:15:40 Job still running ...
2023/04/23 15:16:10 Job still running ...
2023/04/23 15:16:40 Job still running ...
2023/04/23 15:17:10 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-23_08_08_39-4415882098709145642 failed
--- FAIL: TestXLang_Partition (550.90s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2757.652s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682260306593897609
--- FAIL: TestBigQueryIO_BasicWriteRead (5.20s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45337 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gwIFBQXVwk" is_bounded:BOUNDED windowing_strategy_id:"w0@gwIFBQXVwk"}} windowing_strategies:{key:"w0@gwIFBQXVwk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gwIFBQXVwk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gwIFBQXVwk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gwIFBQXVwk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682260306593897609\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gwIFBQXVwk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45337 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gwIFBQXVwk" is_bounded:BOUNDED windowing_strategy_id:"w0@gwIFBQXVwk"}} windowing_strategies:{key:"w0@gwIFBQXVwk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gwIFBQXVwk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gwIFBQXVwk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gwIFBQXVwk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682260306593897609\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gwIFBQXVwk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0004d8e80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0004d8e80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0007260c0?, 0xc00051e000?}, {0x11c4b90, 0x39}, {0xc000548000?, 0x10c4a20?, 0xc0005140c0?}, {0xc00046be10, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000726060?, 0xc00051e000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046be10, 0xf}, {0xc000050e40, 0x52}, {0xf21660, 0xc000716088})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d7860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d7860, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.230s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.038s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-143113
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-143113
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c10f12794ba209bef0cace7f4bd2a10e2a5ebee3474104135de6989eda69c8d3
Deleted: sha256:f511a25e6e0033cf3c5f37a412d54ad5911d43dbb8fff4dfd38c9ea659d6fad8
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-143113
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c10f12794ba209bef0cace7f4bd2a10e2a5ebee3474104135de6989eda69c8d3
Associated tags:
- 20230423-143113
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-143113
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-143113].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c10f12794ba209bef0cace7f4bd2a10e2a5ebee3474104135de6989eda69c8d3].
$ rm -rf /tmp/tmp.PgE7A9udLq
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423142029
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0882b82b1042a63ac1b906142e5eea2fd90afaf3b2f243bdf923b6298cc962ae
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423142029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0882b82b1042a63ac1b906142e5eea2fd90afaf3b2f243bdf923b6298cc962ae]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423142029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0882b82b1042a63ac1b906142e5eea2fd90afaf3b2f243bdf923b6298cc962ae])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0882b82b1042a63ac1b906142e5eea2fd90afaf3b2f243bdf923b6298cc962ae
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0882b82b1042a63ac1b906142e5eea2fd90afaf3b2f243bdf923b6298cc962ae
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0882b82b1042a63ac1b906142e5eea2fd90afaf3b2f243bdf923b6298cc962ae].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423142029
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d05be37930eed504b4049ca9dca08430eb56e843d39d725d8a3ce8dcc4e6b2ca
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423142029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d05be37930eed504b4049ca9dca08430eb56e843d39d725d8a3ce8dcc4e6b2ca]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423142029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d05be37930eed504b4049ca9dca08430eb56e843d39d725d8a3ce8dcc4e6b2ca])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d05be37930eed504b4049ca9dca08430eb56e843d39d725d8a3ce8dcc4e6b2ca
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d05be37930eed504b4049ca9dca08430eb56e843d39d725d8a3ce8dcc4e6b2ca
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d05be37930eed504b4049ca9dca08430eb56e843d39d725d8a3ce8dcc4e6b2ca].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 879097.
Stopping expansion service pid: 879098.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 57m 38s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/4zihnuudnjshm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1560
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1560/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423082029",
"environmentId": "kEqeaZpFVdbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-083118"
}
]
},
"name": "go-testxlang_partition-978",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/23 09:15:18 Submitted job: 2023-04-23_02_15_17-3633718603256619023
2023/04/23 09:15:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-23_02_15_17-3633718603256619023?project=apache-beam-testing
2023/04/23 09:15:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-23_02_15_17-3633718603256619023
2023/04/23 09:15:18 Job state: JOB_STATE_PENDING ...
2023/04/23 09:15:48 Job still running ...
2023/04/23 09:16:18 Job still running ...
2023/04/23 09:16:48 Job still running ...
2023/04/23 09:17:18 Job still running ...
2023/04/23 09:17:48 Job still running ...
2023/04/23 09:18:18 Job still running ...
2023/04/23 09:18:48 Job still running ...
2023/04/23 09:19:18 Job still running ...
2023/04/23 09:19:48 Job still running ...
2023/04/23 09:20:18 Job still running ...
2023/04/23 09:20:48 Job still running ...
2023/04/23 09:21:18 Job still running ...
2023/04/23 09:21:48 Job still running ...
2023/04/23 09:22:18 Job still running ...
2023/04/23 09:22:48 Job still running ...
2023/04/23 09:23:19 Job still running ...
2023/04/23 09:23:49 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-23_02_15_17-3633718603256619023 failed
--- FAIL: TestXLang_Partition (550.50s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3147.325s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682238715345618936
--- FAIL: TestBigQueryIO_BasicWriteRead (4.60s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39529 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@scITXLYdfu" is_bounded:BOUNDED windowing_strategy_id:"w0@scITXLYdfu"}} windowing_strategies:{key:"w0@scITXLYdfu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@scITXLYdfu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@scITXLYdfu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@scITXLYdfu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682238715345618936\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"scITXLYdfu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39529 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@scITXLYdfu" is_bounded:BOUNDED windowing_strategy_id:"w0@scITXLYdfu"}} windowing_strategies:{key:"w0@scITXLYdfu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@scITXLYdfu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@scITXLYdfu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@scITXLYdfu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682238715345618936\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"scITXLYdfu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc000164140})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc000164140})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae9a0?, 0xc000135f90?}, {0x11c4b90, 0x39}, {0xc0000f6180?, 0x10c4a20?, 0xc00054ced0?}, {0xc0005afd60, 0xf}, 0xc00056fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae4e0?, 0xc000135f90?}, {0xc000050e40, 0x52}, {0x1?}, {0xc00056fea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005afd60, 0xf}, {0xc000050e40, 0x52}, {0xf21660, 0xc0001250f0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005831e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005831e0, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.633s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-083118
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-083118
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0899b143b425dc8212e8a85164668084dd4a84a20ac67d819b90c0cf3cac9076
Deleted: sha256:e636d7c1a083f3300608e12fe6769f191155f2d2919a24ab032ec8aff2857d26
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-083118
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0899b143b425dc8212e8a85164668084dd4a84a20ac67d819b90c0cf3cac9076
Associated tags:
- 20230423-083118
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-083118
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-083118].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0899b143b425dc8212e8a85164668084dd4a84a20ac67d819b90c0cf3cac9076].
$ rm -rf /tmp/tmp.Qgmlusx6Hx
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423082029
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:24d4f23e2925cf85e904c69d137050f3a3f3b8093a81349194a9ad0f130917d8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423082029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:24d4f23e2925cf85e904c69d137050f3a3f3b8093a81349194a9ad0f130917d8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423082029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:24d4f23e2925cf85e904c69d137050f3a3f3b8093a81349194a9ad0f130917d8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:24d4f23e2925cf85e904c69d137050f3a3f3b8093a81349194a9ad0f130917d8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:24d4f23e2925cf85e904c69d137050f3a3f3b8093a81349194a9ad0f130917d8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:24d4f23e2925cf85e904c69d137050f3a3f3b8093a81349194a9ad0f130917d8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423082029
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc77aabccb3cf8f244134a8acb67b594798277a478fe6600391b6f4727025034
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423082029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc77aabccb3cf8f244134a8acb67b594798277a478fe6600391b6f4727025034]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423082029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc77aabccb3cf8f244134a8acb67b594798277a478fe6600391b6f4727025034])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc77aabccb3cf8f244134a8acb67b594798277a478fe6600391b6f4727025034
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc77aabccb3cf8f244134a8acb67b594798277a478fe6600391b6f4727025034
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc77aabccb3cf8f244134a8acb67b594798277a478fe6600391b6f4727025034].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 715827.
Stopping expansion service pid: 715828.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 15s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ent3bwndomdbk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1559
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1559/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423022038",
"environmentId": "lesvfHnSBJbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-023116"
}
]
},
"name": "go-testxlang_partition-113",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/23 03:14:50 Submitted job: 2023-04-22_20_14_49-8491908359149888175
2023/04/23 03:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-22_20_14_49-8491908359149888175?project=apache-beam-testing
2023/04/23 03:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-22_20_14_49-8491908359149888175
2023/04/23 03:14:50 Job state: JOB_STATE_PENDING ...
2023/04/23 03:15:20 Job still running ...
2023/04/23 03:15:50 Job still running ...
2023/04/23 03:16:20 Job still running ...
2023/04/23 03:16:50 Job still running ...
2023/04/23 03:17:20 Job still running ...
2023/04/23 03:17:50 Job still running ...
2023/04/23 03:18:20 Job still running ...
2023/04/23 03:18:50 Job still running ...
2023/04/23 03:19:20 Job still running ...
2023/04/23 03:19:50 Job still running ...
2023/04/23 03:20:20 Job still running ...
2023/04/23 03:20:50 Job still running ...
2023/04/23 03:21:20 Job still running ...
2023/04/23 03:21:50 Job still running ...
2023/04/23 03:22:20 Job still running ...
2023/04/23 03:22:50 Job still running ...
2023/04/23 03:23:20 Job still running ...
2023/04/23 03:23:50 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-22_20_14_49-8491908359149888175 failed
--- FAIL: TestXLang_Partition (580.99s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3152.002s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682217112121940012
--- FAIL: TestBigQueryIO_BasicWriteRead (4.45s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38483 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NLLcnHHEwH" is_bounded:BOUNDED windowing_strategy_id:"w0@NLLcnHHEwH"}} windowing_strategies:{key:"w0@NLLcnHHEwH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NLLcnHHEwH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NLLcnHHEwH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NLLcnHHEwH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682217112121940012\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NLLcnHHEwH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38483 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NLLcnHHEwH" is_bounded:BOUNDED windowing_strategy_id:"w0@NLLcnHHEwH"}} windowing_strategies:{key:"w0@NLLcnHHEwH" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NLLcnHHEwH" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NLLcnHHEwH" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NLLcnHHEwH" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682217112121940012\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NLLcnHHEwH"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0002823c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0002823c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00012a080?, 0xc0000c4280?}, {0x11c4b90, 0x39}, {0xc0000f60c0?, 0x10c4a20?, 0xc0001240c0?}, {0xc0005c1cf0, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00012a020?, 0xc0000c4280?}, {0xc0005b8840, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005c1cf0, 0xf}, {0xc0005b8840, 0x52}, {0xf21660, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103860, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.470s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d474c4784d72062cefb2c81c1d4ff5feafce6a322278403043653dc30db80385
Associated tags:
- 20230423-023116
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-023116
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230423-023116].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d474c4784d72062cefb2c81c1d4ff5feafce6a322278403043653dc30db80385].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423022038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a94b2929163c897e47dffddc819700f28a8dbf4bd758746e0593da39aaa1638]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230423022038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a94b2929163c897e47dffddc819700f28a8dbf4bd758746e0593da39aaa1638])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a94b2929163c897e47dffddc819700f28a8dbf4bd758746e0593da39aaa1638
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8a94b2929163c897e47dffddc819700f28a8dbf4bd758746e0593da39aaa1638].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423022038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9f35c38e20a6c44055216e09446cffde91b3aca50ba7aaa39378d32d4b22e44]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230423022038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9f35c38e20a6c44055216e09446cffde91b3aca50ba7aaa39378d32d4b22e44])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9f35c38e20a6c44055216e09446cffde91b3aca50ba7aaa39378d32d4b22e44
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9f35c38e20a6c44055216e09446cffde91b3aca50ba7aaa39378d32d4b22e44].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 12s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/uuwnbtavfoffu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1558
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1558/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422202033",
"environmentId": "gBwueSnuaCbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-203123"
}
]
},
"name": "go-testxlang_partition-756",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/22 21:15:25 Submitted job: 2023-04-22_14_15_24-16209417676858073288
2023/04/22 21:15:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-22_14_15_24-16209417676858073288?project=apache-beam-testing
2023/04/22 21:15:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-22_14_15_24-16209417676858073288
2023/04/22 21:15:25 Job state: JOB_STATE_PENDING ...
2023/04/22 21:15:55 Job still running ...
2023/04/22 21:16:25 Job still running ...
2023/04/22 21:16:55 Job still running ...
2023/04/22 21:17:25 Job still running ...
2023/04/22 21:17:55 Job still running ...
2023/04/22 21:18:25 Job still running ...
2023/04/22 21:18:55 Job still running ...
2023/04/22 21:19:25 Job still running ...
2023/04/22 21:19:55 Job still running ...
2023/04/22 21:20:25 Job still running ...
2023/04/22 21:20:55 Job still running ...
2023/04/22 21:21:25 Job still running ...
2023/04/22 21:21:55 Job still running ...
2023/04/22 21:22:25 Job still running ...
2023/04/22 21:22:55 Job still running ...
2023/04/22 21:23:25 Job still running ...
2023/04/22 21:23:55 Job still running ...
2023/04/22 21:24:25 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-22_14_15_24-16209417676858073288 failed
--- FAIL: TestXLang_Partition (579.78s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3176.355s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682195523920912213
--- FAIL: TestBigQueryIO_BasicWriteRead (5.38s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38011 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oaVkttVDfz" is_bounded:BOUNDED windowing_strategy_id:"w0@oaVkttVDfz"}} windowing_strategies:{key:"w0@oaVkttVDfz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oaVkttVDfz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oaVkttVDfz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oaVkttVDfz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682195523920912213\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oaVkttVDfz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38011 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oaVkttVDfz" is_bounded:BOUNDED windowing_strategy_id:"w0@oaVkttVDfz"}} windowing_strategies:{key:"w0@oaVkttVDfz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oaVkttVDfz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oaVkttVDfz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oaVkttVDfz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682195523920912213\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oaVkttVDfz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0005dc500})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0005dc500})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000720120?, 0xc000618000?}, {0x11c4b90, 0x39}, {0xc0000f60c0?, 0x10c4a20?, 0xc0006100c0?}, {0xc00046dbf0, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0007200c0?, 0xc000618000?}, {0xc000050c60, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dbf0, 0xf}, {0xc000050c60, 0x52}, {0xf21660, 0xc0007142c8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000602d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000602d00, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.412s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9ef12d21c6b8e16d8b4614849f6b48cc249cb957c28c0162ffe6e2aecf44a042
Associated tags:
- 20230422-203123
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-203123
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-203123].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9ef12d21c6b8e16d8b4614849f6b48cc249cb957c28c0162ffe6e2aecf44a042].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422202033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b50cf8687e599566859a4a817d715eb44aef75193c77a6a52d25905544b8b051]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422202033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b50cf8687e599566859a4a817d715eb44aef75193c77a6a52d25905544b8b051])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b50cf8687e599566859a4a817d715eb44aef75193c77a6a52d25905544b8b051
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b50cf8687e599566859a4a817d715eb44aef75193c77a6a52d25905544b8b051].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422202033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2cc647d771f397c4f10e23b87833526ae03f69aaf332f4ee028491ec6f16d7ae]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422202033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2cc647d771f397c4f10e23b87833526ae03f69aaf332f4ee028491ec6f16d7ae])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2cc647d771f397c4f10e23b87833526ae03f69aaf332f4ee028491ec6f16d7ae
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2cc647d771f397c4f10e23b87833526ae03f69aaf332f4ee028491ec6f16d7ae].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 49s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ciy3jfdwljifu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1557
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1557/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-143138",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-143138"
}
]
},
"name": "go-testxlang_partition-593",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/22 15:16:14 Submitted job: 2023-04-22_08_16_13-9815500163046197219
2023/04/22 15:16:14 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-22_08_16_13-9815500163046197219?project=apache-beam-testing
2023/04/22 15:16:14 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-22_08_16_13-9815500163046197219
2023/04/22 15:16:14 Job state: JOB_STATE_PENDING ...
2023/04/22 15:16:44 Job still running ...
2023/04/22 15:17:14 Job still running ...
2023/04/22 15:17:44 Job still running ...
2023/04/22 15:18:14 Job still running ...
2023/04/22 15:18:44 Job still running ...
2023/04/22 15:19:14 Job still running ...
2023/04/22 15:19:44 Job still running ...
2023/04/22 15:20:14 Job still running ...
2023/04/22 15:20:44 Job still running ...
2023/04/22 15:21:14 Job still running ...
2023/04/22 15:21:44 Job still running ...
2023/04/22 15:22:14 Job still running ...
2023/04/22 15:22:44 Job still running ...
2023/04/22 15:23:14 Job still running ...
2023/04/22 15:23:44 Job still running ...
2023/04/22 15:24:14 Job still running ...
2023/04/22 15:24:45 Job still running ...
2023/04/22 15:25:15 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-22_08_16_13-9815500163046197219 failed
--- FAIL: TestXLang_Partition (580.73s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3213.043s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682173935403330672
--- FAIL: TestBigQueryIO_BasicWriteRead (4.51s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42963 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uoPhEakmGs" is_bounded:BOUNDED windowing_strategy_id:"w0@uoPhEakmGs"}} windowing_strategies:{key:"w0@uoPhEakmGs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uoPhEakmGs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uoPhEakmGs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uoPhEakmGs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682173935403330672\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uoPhEakmGs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42963 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uoPhEakmGs" is_bounded:BOUNDED windowing_strategy_id:"w0@uoPhEakmGs"}} windowing_strategies:{key:"w0@uoPhEakmGs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uoPhEakmGs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uoPhEakmGs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uoPhEakmGs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682173935403330672\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uoPhEakmGs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0002ea6c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0002ea6c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006aaf60?, 0xc0001362d0?}, {0x11c4b90, 0x39}, {0xc0001580c0?, 0x10c4a20?, 0xc0001eaf60?}, {0xc000489f80, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006aaf00?, 0xc0001362d0?}, {0xc000050900, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc000050900, 0x52}, {0xf21660, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503520, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.540s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-143138
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-143138
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5a810255f3b2c284e45f85cf1930ed0ebea4a9d8ac734f7b0f658aa0f8fba8ce
Deleted: sha256:f3f57ce80014c47e03d449f3a1aeb0616378ea992d22942df55b37fa3f000532
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-143138
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5a810255f3b2c284e45f85cf1930ed0ebea4a9d8ac734f7b0f658aa0f8fba8ce
Associated tags:
- 20230422-143138
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-143138
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-143138].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5a810255f3b2c284e45f85cf1930ed0ebea4a9d8ac734f7b0f658aa0f8fba8ce].
$ rm -rf /tmp/tmp.CaExtFDzGa
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:868452c05c98285b7b17b5c6ba1337f9c667d23f53d47e3c1337b824ffb47dab
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:868452c05c98285b7b17b5c6ba1337f9c667d23f53d47e3c1337b824ffb47dab]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:868452c05c98285b7b17b5c6ba1337f9c667d23f53d47e3c1337b824ffb47dab])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:868452c05c98285b7b17b5c6ba1337f9c667d23f53d47e3c1337b824ffb47dab
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:868452c05c98285b7b17b5c6ba1337f9c667d23f53d47e3c1337b824ffb47dab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:868452c05c98285b7b17b5c6ba1337f9c667d23f53d47e3c1337b824ffb47dab].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a758a0223be519ffceee9335f232c8cacb204da2c7bbdbf7f9fb6f8175b8f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a758a0223be519ffceee9335f232c8cacb204da2c7bbdbf7f9fb6f8175b8f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a758a0223be519ffceee9335f232c8cacb204da2c7bbdbf7f9fb6f8175b8f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a758a0223be519ffceee9335f232c8cacb204da2c7bbdbf7f9fb6f8175b8f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a758a0223be519ffceee9335f232c8cacb204da2c7bbdbf7f9fb6f8175b8f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a758a0223be519ffceee9335f232c8cacb204da2c7bbdbf7f9fb6f8175b8f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 305755.
Stopping expansion service pid: 305756.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 38s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ch7qgoe72ksb4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1556
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1556/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422082030",
"environmentId": "AGhhuzJGyxbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-083109"
}
]
},
"name": "go-testxlang_partition-676",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/22 09:16:36 Submitted job: 2023-04-22_02_16_36-17979717042289268036
2023/04/22 09:16:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-22_02_16_36-17979717042289268036?project=apache-beam-testing
2023/04/22 09:16:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-22_02_16_36-17979717042289268036
2023/04/22 09:16:36 Job state: JOB_STATE_PENDING ...
2023/04/22 09:17:06 Job still running ...
2023/04/22 09:17:36 Job still running ...
2023/04/22 09:18:06 Job still running ...
2023/04/22 09:18:36 Job still running ...
2023/04/22 09:19:07 Job still running ...
2023/04/22 09:19:37 Job still running ...
2023/04/22 09:20:07 Job still running ...
2023/04/22 09:20:37 Job still running ...
2023/04/22 09:21:07 Job still running ...
2023/04/22 09:21:37 Job still running ...
2023/04/22 09:22:07 Job still running ...
2023/04/22 09:22:37 Job still running ...
2023/04/22 09:23:07 Job still running ...
2023/04/22 09:23:37 Job still running ...
2023/04/22 09:24:07 Job still running ...
2023/04/22 09:24:37 Job still running ...
2023/04/22 09:25:07 Job still running ...
2023/04/22 09:25:37 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-22_02_16_36-17979717042289268036 failed
--- FAIL: TestXLang_Partition (580.77s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3267.782s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682152303221268561
--- FAIL: TestBigQueryIO_BasicWriteRead (5.04s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46795 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qzHVDPSMlt" is_bounded:BOUNDED windowing_strategy_id:"w0@qzHVDPSMlt"}} windowing_strategies:{key:"w0@qzHVDPSMlt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qzHVDPSMlt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qzHVDPSMlt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qzHVDPSMlt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682152303221268561\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qzHVDPSMlt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46795 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qzHVDPSMlt" is_bounded:BOUNDED windowing_strategy_id:"w0@qzHVDPSMlt"}} windowing_strategies:{key:"w0@qzHVDPSMlt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qzHVDPSMlt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qzHVDPSMlt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qzHVDPSMlt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682152303221268561\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qzHVDPSMlt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0000b8bc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0000b8bc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000680120?, 0xc0004f4000?}, {0x11c4b90, 0x39}, {0xc0001580c0?, 0x10c4a20?, 0xc0004ee0c0?}, {0xc000489f80, 0xf}, 0xc0002d3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006800c0?, 0xc0004f4000?}, {0xc00010eba0, 0x52}, {0x1?}, {0xc0002d3ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010eba0, 0x52}, {0xf21660, 0xc00012e078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000501380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000501380, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.066s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-083109
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-083109
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c1f45ac02925cf19fa4e4ebbe098ae5fba250c7d53a92c83c6b2200dc096f0da
Deleted: sha256:e391948b1922d5ece5ab3d00bfa295ae45dae69551d781f5298e3099baf8a037
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-083109
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c1f45ac02925cf19fa4e4ebbe098ae5fba250c7d53a92c83c6b2200dc096f0da
Associated tags:
- 20230422-083109
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-083109
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-083109].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c1f45ac02925cf19fa4e4ebbe098ae5fba250c7d53a92c83c6b2200dc096f0da].
$ rm -rf /tmp/tmp.8dSWb0rmWK
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422082030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8474049cd1e914bbc55404555f540c4b197edb9b1c99909e250616789cde8fd6
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422082030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8474049cd1e914bbc55404555f540c4b197edb9b1c99909e250616789cde8fd6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422082030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8474049cd1e914bbc55404555f540c4b197edb9b1c99909e250616789cde8fd6])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8474049cd1e914bbc55404555f540c4b197edb9b1c99909e250616789cde8fd6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8474049cd1e914bbc55404555f540c4b197edb9b1c99909e250616789cde8fd6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8474049cd1e914bbc55404555f540c4b197edb9b1c99909e250616789cde8fd6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422082030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b59fcc97d9dd61938b78644e52acbbd658c22bee70e83a4c5920f79b08d365ee
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422082030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b59fcc97d9dd61938b78644e52acbbd658c22bee70e83a4c5920f79b08d365ee]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422082030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b59fcc97d9dd61938b78644e52acbbd658c22bee70e83a4c5920f79b08d365ee])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b59fcc97d9dd61938b78644e52acbbd658c22bee70e83a4c5920f79b08d365ee
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b59fcc97d9dd61938b78644e52acbbd658c22bee70e83a4c5920f79b08d365ee
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b59fcc97d9dd61938b78644e52acbbd658c22bee70e83a4c5920f79b08d365ee].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 218261.
Stopping expansion service pid: 218262.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 4s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ley3q25sikkrs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1555
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1555/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422022043",
"environmentId": "EsUUBybPeUbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-023126"
}
]
},
"name": "go-testxlang_partition-499",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/22 03:21:28 Submitted job: 2023-04-21_20_21_28-3932443063548398169
2023/04/22 03:21:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-21_20_21_28-3932443063548398169?project=apache-beam-testing
2023/04/22 03:21:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-21_20_21_28-3932443063548398169
2023/04/22 03:21:28 Job state: JOB_STATE_PENDING ...
2023/04/22 03:21:58 Job still running ...
2023/04/22 03:22:28 Job still running ...
2023/04/22 03:22:58 Job still running ...
2023/04/22 03:23:28 Job still running ...
2023/04/22 03:23:58 Job still running ...
2023/04/22 03:24:29 Job still running ...
2023/04/22 03:24:59 Job still running ...
2023/04/22 03:25:29 Job still running ...
2023/04/22 03:25:59 Job still running ...
2023/04/22 03:26:29 Job still running ...
2023/04/22 03:26:59 Job still running ...
2023/04/22 03:27:29 Job still running ...
2023/04/22 03:27:59 Job still running ...
2023/04/22 03:28:29 Job still running ...
2023/04/22 03:28:59 Job still running ...
2023/04/22 03:29:29 Job still running ...
2023/04/22 03:29:59 Job still running ...
2023/04/22 03:30:29 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-21_20_21_28-3932443063548398169 failed
--- FAIL: TestXLang_Partition (580.45s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3541.515s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682130721389875001
--- FAIL: TestBigQueryIO_BasicWriteRead (4.50s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jxFdEAYBKs" is_bounded:BOUNDED windowing_strategy_id:"w0@jxFdEAYBKs"}} windowing_strategies:{key:"w0@jxFdEAYBKs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jxFdEAYBKs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jxFdEAYBKs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jxFdEAYBKs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682130721389875001\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jxFdEAYBKs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@jxFdEAYBKs" is_bounded:BOUNDED windowing_strategy_id:"w0@jxFdEAYBKs"}} windowing_strategies:{key:"w0@jxFdEAYBKs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@jxFdEAYBKs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@jxFdEAYBKs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@jxFdEAYBKs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682130721389875001\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"jxFdEAYBKs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc00059c340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc00059c340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae840?, 0xc00057a3c0?}, {0x11c4b90, 0x39}, {0xc0000f60c0?, 0x10c4a20?, 0xc000560f00?}, {0xc00046bef0, 0xf}, 0xc0001a5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae4c0?, 0xc00057a3c0?}, {0xc000050de0, 0x52}, {0x1?}, {0xc0001a5ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046bef0, 0xf}, {0xc000050de0, 0x52}, {0xf21660, 0xc000045ae0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103d40, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.533s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.040s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-023126
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-023126
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7a7f897850b05d92179f3347d0485903da6143b3aeb327bedaa5c14d33f7cdd3
Deleted: sha256:b1458b7242c91176ea6885c01a57f9af2334f5465f5bd71e8c5908c4388632d8
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-023126
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7a7f897850b05d92179f3347d0485903da6143b3aeb327bedaa5c14d33f7cdd3
Associated tags:
- 20230422-023126
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-023126
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230422-023126].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7a7f897850b05d92179f3347d0485903da6143b3aeb327bedaa5c14d33f7cdd3].
$ rm -rf /tmp/tmp.QnTGydAw7A
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422022043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f9cf86cd7caa63437548ceb6d35f306ebfd42d88635a068e72d83dd79276b08
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422022043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f9cf86cd7caa63437548ceb6d35f306ebfd42d88635a068e72d83dd79276b08]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230422022043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f9cf86cd7caa63437548ceb6d35f306ebfd42d88635a068e72d83dd79276b08])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f9cf86cd7caa63437548ceb6d35f306ebfd42d88635a068e72d83dd79276b08
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f9cf86cd7caa63437548ceb6d35f306ebfd42d88635a068e72d83dd79276b08
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f9cf86cd7caa63437548ceb6d35f306ebfd42d88635a068e72d83dd79276b08].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422022043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc1f66806eae208b08a8d5cc745330b6fa2350e590f3e28ee44712ac509407ab
Deleted: sha256:4ab38c6101c986010720c75c074381a237e18e3b975e29d6bceb1af7a622213a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422022043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc1f66806eae208b08a8d5cc745330b6fa2350e590f3e28ee44712ac509407ab]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230422022043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc1f66806eae208b08a8d5cc745330b6fa2350e590f3e28ee44712ac509407ab])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc1f66806eae208b08a8d5cc745330b6fa2350e590f3e28ee44712ac509407ab
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc1f66806eae208b08a8d5cc745330b6fa2350e590f3e28ee44712ac509407ab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc1f66806eae208b08a8d5cc745330b6fa2350e590f3e28ee44712ac509407ab].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4173305.
Stopping expansion service pid: 4173306.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 44s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/xd2f4zafeqjbq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1554
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1554/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421202043",
"environmentId": "VXTqbEWYZAbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-203142"
}
]
},
"name": "go-testxlang_partition-91",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/21 21:14:52 Submitted job: 2023-04-21_14_14_51-13330875033732844153
2023/04/21 21:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-21_14_14_51-13330875033732844153?project=apache-beam-testing
2023/04/21 21:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-21_14_14_51-13330875033732844153
2023/04/21 21:14:52 Job state: JOB_STATE_PENDING ...
2023/04/21 21:15:22 Job still running ...
2023/04/21 21:15:52 Job still running ...
2023/04/21 21:16:22 Job still running ...
2023/04/21 21:16:52 Job still running ...
2023/04/21 21:17:22 Job still running ...
2023/04/21 21:17:52 Job still running ...
2023/04/21 21:18:22 Job still running ...
2023/04/21 21:18:52 Job still running ...
2023/04/21 21:19:22 Job still running ...
2023/04/21 21:19:52 Job still running ...
2023/04/21 21:20:22 Job still running ...
2023/04/21 21:20:52 Job still running ...
2023/04/21 21:21:22 Job still running ...
2023/04/21 21:21:52 Job still running ...
2023/04/21 21:22:22 Job still running ...
2023/04/21 21:22:52 Job still running ...
2023/04/21 21:23:22 Job still running ...
2023/04/21 21:23:52 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-21_14_14_51-13330875033732844153 failed
--- FAIL: TestXLang_Partition (580.62s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3119.603s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682109148489765284
--- FAIL: TestBigQueryIO_BasicWriteRead (5.72s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44995 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gmkwvMlNSp" is_bounded:BOUNDED windowing_strategy_id:"w0@gmkwvMlNSp"}} windowing_strategies:{key:"w0@gmkwvMlNSp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gmkwvMlNSp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gmkwvMlNSp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gmkwvMlNSp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682109148489765284\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gmkwvMlNSp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44995 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gmkwvMlNSp" is_bounded:BOUNDED windowing_strategy_id:"w0@gmkwvMlNSp"}} windowing_strategies:{key:"w0@gmkwvMlNSp" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gmkwvMlNSp" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gmkwvMlNSp" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gmkwvMlNSp" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682109148489765284\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gmkwvMlNSp"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc00068b100})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc00068b100})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0002d2f00?, 0xc0001362d0?}, {0x11c4b90, 0x39}, {0xc0001580c0?, 0x10c4a20?, 0xc0002e6ba0?}, {0xc000489f60, 0xf}, 0xc000327d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0002d2ea0?, 0xc0001362d0?}, {0xc000050900, 0x52}, {0x1?}, {0xc000327ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f60, 0xf}, {0xc000050900, 0x52}, {0xf21660, 0xc00012fab0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000582d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000582d00, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.745s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.052s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-203142
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-203142
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9c63c6f6e8fa6f40598d345f1413604678c3300f1993cd40aa5188231b7595aa
Deleted: sha256:7d9b554fe2937ed2086e6181445c502698baa9d03019a14c9d49c7bad920b76b
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-203142
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9c63c6f6e8fa6f40598d345f1413604678c3300f1993cd40aa5188231b7595aa
Associated tags:
- 20230421-203142
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-203142
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-203142].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9c63c6f6e8fa6f40598d345f1413604678c3300f1993cd40aa5188231b7595aa].
$ rm -rf /tmp/tmp.khkfum1taF
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421202043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbb9c381b162fe20c5187040051d8cef115c3809d15541400752dddac2cd7111
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421202043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbb9c381b162fe20c5187040051d8cef115c3809d15541400752dddac2cd7111]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421202043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbb9c381b162fe20c5187040051d8cef115c3809d15541400752dddac2cd7111])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbb9c381b162fe20c5187040051d8cef115c3809d15541400752dddac2cd7111
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbb9c381b162fe20c5187040051d8cef115c3809d15541400752dddac2cd7111
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dbb9c381b162fe20c5187040051d8cef115c3809d15541400752dddac2cd7111].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421202043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6b9af823f8055b265127753af1d1c3e550b603cda6c9cac364ab86814772cf
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421202043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6b9af823f8055b265127753af1d1c3e550b603cda6c9cac364ab86814772cf]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421202043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6b9af823f8055b265127753af1d1c3e550b603cda6c9cac364ab86814772cf])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6b9af823f8055b265127753af1d1c3e550b603cda6c9cac364ab86814772cf
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6b9af823f8055b265127753af1d1c3e550b603cda6c9cac364ab86814772cf
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fd6b9af823f8055b265127753af1d1c3e550b603cda6c9cac364ab86814772cf].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3716773.
Stopping expansion service pid: 3716774.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 6s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/gz67kposaxuuo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1553
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1553/display/redirect?page=changes>
Changes:
[noreply] Add release number to python wheels script (#26375)
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421142045",
"environmentId": "YwNgjROwpJbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-143224"
}
]
},
"name": "go-testxlang_partition-432",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/21 15:18:01 Submitted job: 2023-04-21_08_18_00-14309438473968898977
2023/04/21 15:18:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-21_08_18_00-14309438473968898977?project=apache-beam-testing
2023/04/21 15:18:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-21_08_18_00-14309438473968898977
2023/04/21 15:18:01 Job state: JOB_STATE_PENDING ...
2023/04/21 15:18:31 Job still running ...
2023/04/21 15:19:01 Job still running ...
2023/04/21 15:19:31 Job still running ...
2023/04/21 15:20:01 Job still running ...
2023/04/21 15:20:31 Job still running ...
2023/04/21 15:21:01 Job still running ...
2023/04/21 15:21:31 Job still running ...
2023/04/21 15:22:01 Job still running ...
2023/04/21 15:22:32 Job still running ...
2023/04/21 15:23:02 Job still running ...
2023/04/21 15:23:32 Job still running ...
2023/04/21 15:24:02 Job still running ...
2023/04/21 15:24:32 Job still running ...
2023/04/21 15:25:02 Job still running ...
2023/04/21 15:25:32 Job still running ...
2023/04/21 15:26:02 Job still running ...
2023/04/21 15:26:32 Job still running ...
2023/04/21 15:27:02 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-21_08_18_00-14309438473968898977 failed
--- FAIL: TestXLang_Partition (581.72s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3275.746s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682087584735996525
--- FAIL: TestBigQueryIO_BasicWriteRead (5.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42571 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tCAPhhZmBR" is_bounded:BOUNDED windowing_strategy_id:"w0@tCAPhhZmBR"}} windowing_strategies:{key:"w0@tCAPhhZmBR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tCAPhhZmBR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tCAPhhZmBR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tCAPhhZmBR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682087584735996525\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tCAPhhZmBR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42571 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tCAPhhZmBR" is_bounded:BOUNDED windowing_strategy_id:"w0@tCAPhhZmBR"}} windowing_strategies:{key:"w0@tCAPhhZmBR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tCAPhhZmBR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tCAPhhZmBR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tCAPhhZmBR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682087584735996525\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tCAPhhZmBR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc00019c880})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc00019c880})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae0a0?, 0xc0000c4050?}, {0x11c4b90, 0x39}, {0xc0001580c0?, 0x10c4a20?, 0xc0004ec0c0?}, {0xc000489f60, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc0000c4050?}, {0xc00010eba0, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f60, 0xf}, {0xc00010eba0, 0x52}, {0xf21660, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031f520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031f520, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.681s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.048s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-143224
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-143224
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8ae8017c19363a49ed148fbfa3a4fa27b5c5867b864bb0f61762e2b2382efffd
Deleted: sha256:8b9f71a1b00698dedbcea19bf44c6270ed82e36d126c4e69b2beac388661c5f6
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-143224
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8ae8017c19363a49ed148fbfa3a4fa27b5c5867b864bb0f61762e2b2382efffd
Associated tags:
- 20230421-143224
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-143224
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-143224].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8ae8017c19363a49ed148fbfa3a4fa27b5c5867b864bb0f61762e2b2382efffd].
$ rm -rf /tmp/tmp.Rpps0o4UXS
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421142045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:361e8852bd23db3d80739c6da0c9562548a4ea806f215ea011063472f701f7dc
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421142045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:361e8852bd23db3d80739c6da0c9562548a4ea806f215ea011063472f701f7dc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421142045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:361e8852bd23db3d80739c6da0c9562548a4ea806f215ea011063472f701f7dc])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:361e8852bd23db3d80739c6da0c9562548a4ea806f215ea011063472f701f7dc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:361e8852bd23db3d80739c6da0c9562548a4ea806f215ea011063472f701f7dc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:361e8852bd23db3d80739c6da0c9562548a4ea806f215ea011063472f701f7dc].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421142045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:933ccf1ba6019c4bfce716717e3fa182b13eda4f4d1c0fac4fffbf1a14951fec
Deleted: sha256:4523f5c75adfae88d1880b8af8416461dea22738c79a5d12144b5d52d325a94d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421142045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:933ccf1ba6019c4bfce716717e3fa182b13eda4f4d1c0fac4fffbf1a14951fec]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421142045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:933ccf1ba6019c4bfce716717e3fa182b13eda4f4d1c0fac4fffbf1a14951fec])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:933ccf1ba6019c4bfce716717e3fa182b13eda4f4d1c0fac4fffbf1a14951fec
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:933ccf1ba6019c4bfce716717e3fa182b13eda4f4d1c0fac4fffbf1a14951fec
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:933ccf1ba6019c4bfce716717e3fa182b13eda4f4d1c0fac4fffbf1a14951fec].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3283104.
Stopping expansion service pid: 3283105.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 18s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/c2ixpjca4225m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1552
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1552/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421082041",
"environmentId": "aUQDHufwWnbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-083125"
}
]
},
"name": "go-testxlang_partition-116",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/21 09:18:56 Submitted job: 2023-04-21_02_18_56-2108064213812989164
2023/04/21 09:18:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-21_02_18_56-2108064213812989164?project=apache-beam-testing
2023/04/21 09:18:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-21_02_18_56-2108064213812989164
2023/04/21 09:18:56 Job state: JOB_STATE_PENDING ...
2023/04/21 09:19:26 Job still running ...
2023/04/21 09:19:56 Job still running ...
2023/04/21 09:20:26 Job still running ...
2023/04/21 09:20:56 Job still running ...
2023/04/21 09:21:27 Job still running ...
2023/04/21 09:21:57 Job still running ...
2023/04/21 09:22:27 Job still running ...
2023/04/21 09:22:57 Job still running ...
2023/04/21 09:23:27 Job still running ...
2023/04/21 09:23:57 Job still running ...
2023/04/21 09:24:27 Job still running ...
2023/04/21 09:24:57 Job still running ...
2023/04/21 09:25:27 Job still running ...
2023/04/21 09:25:57 Job still running ...
2023/04/21 09:26:27 Job still running ...
2023/04/21 09:26:57 Job still running ...
2023/04/21 09:27:27 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-21_02_18_56-2108064213812989164 failed
--- FAIL: TestXLang_Partition (550.62s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3363.533s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682065917529852217
--- FAIL: TestBigQueryIO_BasicWriteRead (4.51s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44681 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZprKmFMnwi" is_bounded:BOUNDED windowing_strategy_id:"w0@ZprKmFMnwi"}} windowing_strategies:{key:"w0@ZprKmFMnwi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZprKmFMnwi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZprKmFMnwi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZprKmFMnwi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682065917529852217\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZprKmFMnwi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44681 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZprKmFMnwi" is_bounded:BOUNDED windowing_strategy_id:"w0@ZprKmFMnwi"}} windowing_strategies:{key:"w0@ZprKmFMnwi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZprKmFMnwi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZprKmFMnwi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZprKmFMnwi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682065917529852217\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZprKmFMnwi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc0006d8340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc0006d8340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1c0?, 0xc0005ac0f0?}, {0x11c4b90, 0x39}, {0xc0000f60c0?, 0x10c4a20?, 0xc0001660c0?}, {0xc000139db0, 0xf}, 0xc000567d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc0005ac0f0?}, {0xc0005a47e0, 0x52}, {0x1?}, {0xc000567ea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000139db0, 0xf}, {0xc0005a47e0, 0x52}, {0xf21660, 0xc00046c008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103d40, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.533s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a4e9d1249bd558b4a812b2c20f786bdcaf3fe7ceeb8ee3bf8578774900a1b4f6
Associated tags:
- 20230421-083125
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-083125
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-083125].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a4e9d1249bd558b4a812b2c20f786bdcaf3fe7ceeb8ee3bf8578774900a1b4f6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:60bc66c18ebe979f4c5db90ad8d399bfb1cc5784ff8ce3f2c91371df3c1d1b73]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:60bc66c18ebe979f4c5db90ad8d399bfb1cc5784ff8ce3f2c91371df3c1d1b73])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:60bc66c18ebe979f4c5db90ad8d399bfb1cc5784ff8ce3f2c91371df3c1d1b73
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:60bc66c18ebe979f4c5db90ad8d399bfb1cc5784ff8ce3f2c91371df3c1d1b73].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c661b68f53cd3c94e79d7d817221c28fe65d2a12fddec0676cc61bafbc993c07]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c661b68f53cd3c94e79d7d817221c28fe65d2a12fddec0676cc61bafbc993c07])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c661b68f53cd3c94e79d7d817221c28fe65d2a12fddec0676cc61bafbc993c07
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c661b68f53cd3c94e79d7d817221c28fe65d2a12fddec0676cc61bafbc993c07].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 43s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/uelpbrk4nbbua
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1551
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1551/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421022041",
"environmentId": "aUgUTjHGvZbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-023159"
}
]
},
"name": "go-testxlang_partition-550",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/21 03:13:39 Submitted job: 2023-04-20_20_13_38-10218858011101307769
2023/04/21 03:13:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-20_20_13_38-10218858011101307769?project=apache-beam-testing
2023/04/21 03:13:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-20_20_13_38-10218858011101307769
2023/04/21 03:13:39 Job state: JOB_STATE_PENDING ...
2023/04/21 03:14:09 Job still running ...
2023/04/21 03:14:39 Job still running ...
2023/04/21 03:15:09 Job still running ...
2023/04/21 03:15:39 Job still running ...
2023/04/21 03:16:09 Job still running ...
2023/04/21 03:16:39 Job still running ...
2023/04/21 03:17:09 Job still running ...
2023/04/21 03:17:39 Job still running ...
2023/04/21 03:18:09 Job still running ...
2023/04/21 03:18:39 Job still running ...
2023/04/21 03:19:09 Job still running ...
2023/04/21 03:19:39 Job still running ...
2023/04/21 03:20:09 Job still running ...
2023/04/21 03:20:40 Job still running ...
2023/04/21 03:21:10 Job still running ...
2023/04/21 03:21:40 Job still running ...
2023/04/21 03:22:10 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-20_20_13_38-10218858011101307769 failed
--- FAIL: TestXLang_Partition (551.44s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3008.256s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682044359746224889
--- FAIL: TestBigQueryIO_BasicWriteRead (5.49s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37267 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PwdPKtKUAq" is_bounded:BOUNDED windowing_strategy_id:"w0@PwdPKtKUAq"}} windowing_strategies:{key:"w0@PwdPKtKUAq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PwdPKtKUAq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PwdPKtKUAq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PwdPKtKUAq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682044359746224889\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PwdPKtKUAq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37267 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PwdPKtKUAq" is_bounded:BOUNDED windowing_strategy_id:"w0@PwdPKtKUAq"}} windowing_strategies:{key:"w0@PwdPKtKUAq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PwdPKtKUAq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PwdPKtKUAq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PwdPKtKUAq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682044359746224889\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PwdPKtKUAq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdcb40, 0xc000130240})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdcb40, 0xc000130240})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae9a0?, 0xc0007143c0?}, {0x11c4b90, 0x39}, {0xc0000f6180?, 0x10c4a20?, 0xc000548f00?}, {0xc0005afd60, 0xf}, 0xc00056dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae4e0?, 0xc0007143c0?}, {0xc000050e40, 0x52}, {0x1?}, {0xc00056dea8, 0x2, 0xedcbc0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0005afd60, 0xf}, {0xc000050e40, 0x52}, {0xf21660, 0xc00046d1a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583520, 0x11f79c8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.516s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-023159
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-023159
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:055d52e6bb575c10c5a01df0040ff32a2904e79c64426da2c61be08986409921
Deleted: sha256:19ea1abd128aa86e0dbf7f11049949de08ae3dbdf2fad9afff27bc9befb7a78e
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-023159
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:055d52e6bb575c10c5a01df0040ff32a2904e79c64426da2c61be08986409921
Associated tags:
- 20230421-023159
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-023159
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230421-023159].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:055d52e6bb575c10c5a01df0040ff32a2904e79c64426da2c61be08986409921].
$ rm -rf /tmp/tmp.3Fs5HJHxcz
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cd0decccf42241286137e313e9c143e6ac73a3b2d828f09c661a742fd0048444
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cd0decccf42241286137e313e9c143e6ac73a3b2d828f09c661a742fd0048444]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230421022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cd0decccf42241286137e313e9c143e6ac73a3b2d828f09c661a742fd0048444])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cd0decccf42241286137e313e9c143e6ac73a3b2d828f09c661a742fd0048444
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cd0decccf42241286137e313e9c143e6ac73a3b2d828f09c661a742fd0048444
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cd0decccf42241286137e313e9c143e6ac73a3b2d828f09c661a742fd0048444].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c0ab31001ca574bc718900aa6b33ee8eb61acf6eafb77f210074572287501a54
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c0ab31001ca574bc718900aa6b33ee8eb61acf6eafb77f210074572287501a54]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230421022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c0ab31001ca574bc718900aa6b33ee8eb61acf6eafb77f210074572287501a54])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c0ab31001ca574bc718900aa6b33ee8eb61acf6eafb77f210074572287501a54
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c0ab31001ca574bc718900aa6b33ee8eb61acf6eafb77f210074572287501a54
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c0ab31001ca574bc718900aa6b33ee8eb61acf6eafb77f210074572287501a54].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2233476.
Stopping expansion service pid: 2233477.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 26s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/jul2b5oxyvnug
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1550
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1550/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420202031",
"environmentId": "PYUTeMGEbDbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-203209"
}
]
},
"name": "go-testxlang_partition-984",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/20 21:17:56 Submitted job: 2023-04-20_14_17_56-13717425668996955489
2023/04/20 21:17:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-20_14_17_56-13717425668996955489?project=apache-beam-testing
2023/04/20 21:17:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-20_14_17_56-13717425668996955489
2023/04/20 21:17:56 Job state: JOB_STATE_PENDING ...
2023/04/20 21:18:26 Job still running ...
2023/04/20 21:18:56 Job still running ...
2023/04/20 21:19:27 Job still running ...
2023/04/20 21:19:57 Job still running ...
2023/04/20 21:20:27 Job still running ...
2023/04/20 21:20:57 Job still running ...
2023/04/20 21:21:27 Job still running ...
2023/04/20 21:21:57 Job still running ...
2023/04/20 21:22:27 Job still running ...
2023/04/20 21:22:57 Job still running ...
2023/04/20 21:23:27 Job still running ...
2023/04/20 21:23:57 Job still running ...
2023/04/20 21:24:27 Job still running ...
2023/04/20 21:24:57 Job still running ...
2023/04/20 21:25:27 Job still running ...
2023/04/20 21:25:57 Job still running ...
2023/04/20 21:26:27 Job still running ...
2023/04/20 21:26:57 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-20_14_17_56-13717425668996955489 failed
--- FAIL: TestXLang_Partition (580.96s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3279.877s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682022776154482729
--- FAIL: TestBigQueryIO_BasicWriteRead (5.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39771 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@mjxWBAGmro" is_bounded:BOUNDED windowing_strategy_id:"w0@mjxWBAGmro"}} windowing_strategies:{key:"w0@mjxWBAGmro" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@mjxWBAGmro" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@mjxWBAGmro" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@mjxWBAGmro" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682022776154482729\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"mjxWBAGmro"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39771 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@mjxWBAGmro" is_bounded:BOUNDED windowing_strategy_id:"w0@mjxWBAGmro"}} windowing_strategies:{key:"w0@mjxWBAGmro" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@mjxWBAGmro" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@mjxWBAGmro" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@mjxWBAGmro" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682022776154482729\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"mjxWBAGmro"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:306)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:355)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:867)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0003f2d00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0003f2d00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00016ab80?, 0xc000136320?}, {0x11c4aa8, 0x39}, {0xc0001580c0?, 0x10c4960?, 0xc00029af60?}, {0xc000045f40, 0xf}, 0xc0002d3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00016ab00?, 0xc000136320?}, {0xc000050900, 0x52}, {0x1?}, {0xc0002d3ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc000050900, 0x52}, {0xf21600, 0xc000489330})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503ba0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.679s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.040s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:10eb3d5381b567f9d2fd69659a2a8756e90cce8ba22ddb0174d58828d7c56fe6
Associated tags:
- 20230420-203209
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-203209
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-203209].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:10eb3d5381b567f9d2fd69659a2a8756e90cce8ba22ddb0174d58828d7c56fe6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:574444554885bbe6c16f37555e0707055da989dcd17d22cd1f16696c79f3fc4d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:574444554885bbe6c16f37555e0707055da989dcd17d22cd1f16696c79f3fc4d])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:574444554885bbe6c16f37555e0707055da989dcd17d22cd1f16696c79f3fc4d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:574444554885bbe6c16f37555e0707055da989dcd17d22cd1f16696c79f3fc4d].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64b2725ddb172cc99deb2947ee621c799a23e66a3135b2bd132da8fb074286b3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64b2725ddb172cc99deb2947ee621c799a23e66a3135b2bd132da8fb074286b3])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64b2725ddb172cc99deb2947ee621c799a23e66a3135b2bd132da8fb074286b3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:64b2725ddb172cc99deb2947ee621c799a23e66a3135b2bd132da8fb074286b3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 42s
232 actionable tasks: 168 executed, 52 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/zgr2g36suffgm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1549
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1549/display/redirect?page=changes>
Changes:
[noreply] Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks (#26366)
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420144050",
"environmentId": "eazxqnIjqxbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-145426"
}
]
},
"name": "go-testxlang_partition-254",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/20 15:42:35 Submitted job: 2023-04-20_08_42_35-3744999173309026920
2023/04/20 15:42:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-20_08_42_35-3744999173309026920?project=apache-beam-testing
2023/04/20 15:42:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-20_08_42_35-3744999173309026920
2023/04/20 15:42:35 Job state: JOB_STATE_PENDING ...
2023/04/20 15:43:05 Job still running ...
2023/04/20 15:43:35 Job still running ...
2023/04/20 15:44:05 Job still running ...
2023/04/20 15:44:35 Job still running ...
2023/04/20 15:45:05 Job still running ...
2023/04/20 15:45:35 Job still running ...
2023/04/20 15:46:05 Job still running ...
2023/04/20 15:46:35 Job still running ...
2023/04/20 15:47:06 Job still running ...
2023/04/20 15:47:36 Job still running ...
2023/04/20 15:48:06 Job still running ...
2023/04/20 15:48:36 Job still running ...
2023/04/20 15:49:06 Job still running ...
2023/04/20 15:49:36 Job still running ...
2023/04/20 15:50:06 Job still running ...
2023/04/20 15:50:36 Job still running ...
2023/04/20 15:51:06 Job still running ...
2023/04/20 15:51:36 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-20_08_42_35-3744999173309026920 failed
--- FAIL: TestXLang_Partition (581.30s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3427.190s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682002507699985117
--- FAIL: TestBigQueryIO_BasicWriteRead (5.89s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42167 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tXARtAhRBR" is_bounded:BOUNDED windowing_strategy_id:"w0@tXARtAhRBR"}} windowing_strategies:{key:"w0@tXARtAhRBR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tXARtAhRBR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tXARtAhRBR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tXARtAhRBR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682002507699985117\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tXARtAhRBR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42167 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tXARtAhRBR" is_bounded:BOUNDED windowing_strategy_id:"w0@tXARtAhRBR"}} windowing_strategies:{key:"w0@tXARtAhRBR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tXARtAhRBR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tXARtAhRBR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tXARtAhRBR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1682002507699985117\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tXARtAhRBR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00060e7c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00060e7c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1c0?, 0xc0006d6000?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc0006ce0c0?}, {0xc00046dbd0, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc0006d6000?}, {0xc000050d20, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046dbd0, 0xf}, {0xc000050d20, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c2b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c2b60, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.920s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-145426
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-145426
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:599a59d2dbbf81979835406901c390b6d9cd29979aae437f39b087f1d0599b95
Deleted: sha256:47d2c590e2b0d841c6b4b7ba37406b731ba1ccdffa56ffa65abe26ea702fefe1
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-145426
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:599a59d2dbbf81979835406901c390b6d9cd29979aae437f39b087f1d0599b95
Associated tags:
- 20230420-145426
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-145426
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-145426].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:599a59d2dbbf81979835406901c390b6d9cd29979aae437f39b087f1d0599b95].
$ rm -rf /tmp/tmp.hZ8LpBSn8Q
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420144050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1985fe2e58aa28bfe3dc8e489277a18702c225522b672d8d626bc480aa9f168b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420144050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1985fe2e58aa28bfe3dc8e489277a18702c225522b672d8d626bc480aa9f168b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420144050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1985fe2e58aa28bfe3dc8e489277a18702c225522b672d8d626bc480aa9f168b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1985fe2e58aa28bfe3dc8e489277a18702c225522b672d8d626bc480aa9f168b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1985fe2e58aa28bfe3dc8e489277a18702c225522b672d8d626bc480aa9f168b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1985fe2e58aa28bfe3dc8e489277a18702c225522b672d8d626bc480aa9f168b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420144050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:898b20ebecd8bd1c346cba21be83dd50087aac14f089266870c3f16979c49bab
Deleted: sha256:0050b698c975f41bd7e8209876024a014c643e9cb1bc6cb43f3eb1539dd8ee0d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420144050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:898b20ebecd8bd1c346cba21be83dd50087aac14f089266870c3f16979c49bab]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420144050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:898b20ebecd8bd1c346cba21be83dd50087aac14f089266870c3f16979c49bab])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:898b20ebecd8bd1c346cba21be83dd50087aac14f089266870c3f16979c49bab
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:898b20ebecd8bd1c346cba21be83dd50087aac14f089266870c3f16979c49bab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:898b20ebecd8bd1c346cba21be83dd50087aac14f089266870c3f16979c49bab].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2895246.
Stopping expansion service pid: 2895247.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 11m 58s
232 actionable tasks: 171 executed, 49 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/tsdenocxwiqxy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1548
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1548/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420082040",
"environmentId": "BEkXdieuSnbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-083103"
}
]
},
"name": "go-testxlang_partition-45",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/20 09:18:41 Submitted job: 2023-04-20_02_18_40-7132903183946696796
2023/04/20 09:18:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-20_02_18_40-7132903183946696796?project=apache-beam-testing
2023/04/20 09:18:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-20_02_18_40-7132903183946696796
2023/04/20 09:18:41 Job state: JOB_STATE_PENDING ...
2023/04/20 09:19:11 Job still running ...
2023/04/20 09:19:41 Job still running ...
2023/04/20 09:20:11 Job still running ...
2023/04/20 09:20:41 Job still running ...
2023/04/20 09:21:11 Job still running ...
2023/04/20 09:21:44 Job still running ...
2023/04/20 09:22:14 Job still running ...
2023/04/20 09:22:44 Job still running ...
2023/04/20 09:23:14 Job still running ...
2023/04/20 09:23:44 Job still running ...
2023/04/20 09:24:14 Job still running ...
2023/04/20 09:24:45 Job still running ...
2023/04/20 09:25:15 Job still running ...
2023/04/20 09:25:45 Job still running ...
2023/04/20 09:26:15 Job still running ...
2023/04/20 09:26:45 Job still running ...
2023/04/20 09:27:15 Job still running ...
2023/04/20 09:27:45 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-20_02_18_40-7132903183946696796 failed
--- FAIL: TestXLang_Partition (584.81s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3402.950s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681979495957176726
--- FAIL: TestBigQueryIO_BasicWriteRead (4.54s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40367 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QaodBRkVGN" is_bounded:BOUNDED windowing_strategy_id:"w0@QaodBRkVGN"}} windowing_strategies:{key:"w0@QaodBRkVGN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QaodBRkVGN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QaodBRkVGN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QaodBRkVGN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681979495957176726\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QaodBRkVGN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40367 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QaodBRkVGN" is_bounded:BOUNDED windowing_strategy_id:"w0@QaodBRkVGN"}} windowing_strategies:{key:"w0@QaodBRkVGN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QaodBRkVGN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QaodBRkVGN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QaodBRkVGN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681979495957176726\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QaodBRkVGN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0004f8e40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0004f8e40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000534080?, 0xc000536000?}, {0x11c4aa8, 0x39}, {0xc00015a0c0?, 0x10c4960?, 0xc00052c0c0?}, {0xc000045ef0, 0xf}, 0xc000217d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000534020?, 0xc000536000?}, {0xc000050900, 0x52}, {0x1?}, {0xc000217ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045ef0, 0xf}, {0xc000050900, 0x52}, {0xf21600, 0xc000132078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.565s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-083103
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-083103
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:18659ee6e8f980758294d8de3bfa387e2284bbdebf5d21fd3599701c4e417d5c
Deleted: sha256:e713831762ebd8bffd599ec709c39ec79079861c7cdbbf0e425bc02f1a834e56
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-083103
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:18659ee6e8f980758294d8de3bfa387e2284bbdebf5d21fd3599701c4e417d5c
Associated tags:
- 20230420-083103
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-083103
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-083103].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:18659ee6e8f980758294d8de3bfa387e2284bbdebf5d21fd3599701c4e417d5c].
$ rm -rf /tmp/tmp.Uo4KSgUvEV
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34974c0a210df3e7d3891b1ced9426fd5b2e8d1d8b2404fe87ec880b3d77cd58
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34974c0a210df3e7d3891b1ced9426fd5b2e8d1d8b2404fe87ec880b3d77cd58]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34974c0a210df3e7d3891b1ced9426fd5b2e8d1d8b2404fe87ec880b3d77cd58])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34974c0a210df3e7d3891b1ced9426fd5b2e8d1d8b2404fe87ec880b3d77cd58
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34974c0a210df3e7d3891b1ced9426fd5b2e8d1d8b2404fe87ec880b3d77cd58
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34974c0a210df3e7d3891b1ced9426fd5b2e8d1d8b2404fe87ec880b3d77cd58].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7b9eec4d158bd1bcb8759cdbb21288ca70826d482f5ff8ec1a72be95f8dd29e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7b9eec4d158bd1bcb8759cdbb21288ca70826d482f5ff8ec1a72be95f8dd29e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7b9eec4d158bd1bcb8759cdbb21288ca70826d482f5ff8ec1a72be95f8dd29e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7b9eec4d158bd1bcb8759cdbb21288ca70826d482f5ff8ec1a72be95f8dd29e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7b9eec4d158bd1bcb8759cdbb21288ca70826d482f5ff8ec1a72be95f8dd29e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7b9eec4d158bd1bcb8759cdbb21288ca70826d482f5ff8ec1a72be95f8dd29e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4106960.
Stopping expansion service pid: 4106961.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 13s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/xm5xuipgdrnrg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1547
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1547/display/redirect>
Changes:
------------------------------------------
[...truncated 692.69 KB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420022041",
"environmentId": "nvptTOCVoRbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-023128"
}
]
},
"name": "go-testxlang_prefix-441",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/20 02:32:12 Submitted job: 2023-04-19_19_32_12-7909331986255755697
2023/04/20 02:32:12 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-19_19_32_12-7909331986255755697?project=apache-beam-testing
2023/04/20 02:32:12 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-19_19_32_12-7909331986255755697
2023/04/20 02:32:12 Job state: JOB_STATE_PENDING ...
2023/04/20 02:32:42 Job still running ...
2023/04/20 02:33:12 Job still running ...
2023/04/20 02:33:42 Job still running ...
2023/04/20 02:34:13 Job still running ...
2023/04/20 02:34:43 Job still running ...
2023/04/20 02:35:13 Job still running ...
2023/04/20 02:35:43 Job still running ...
2023/04/20 02:36:13 Job still running ...
2023/04/20 02:36:43 Job still running ...
2023/04/20 02:37:13 Job still running ...
2023/04/20 02:37:43 Job still running ...
2023/04/20 02:38:13 Job still running ...
2023/04/20 02:38:43 Job still running ...
2023/04/20 02:39:13 Job still running ...
2023/04/20 02:39:43 Job still running ...
2023/04/20 02:40:13 Job still running ...
2023/04/20 02:40:43 Job still running ...
2023/04/20 02:41:13 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-19_19_32_12-7909331986255755697 failed
--- FAIL: TestXLang_Prefix (582.59s)
=== RUN TestXLang_CoGroupBy
2023/04/20 02:41:44 Unsupported artifact type beam:artifact:type:deferred:v1
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 585.904s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681957925177166042
--- FAIL: TestBigQueryIO_BasicWriteRead (5.39s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42875 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YoFJKxottj" is_bounded:BOUNDED windowing_strategy_id:"w0@YoFJKxottj"}} windowing_strategies:{key:"w0@YoFJKxottj" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YoFJKxottj" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YoFJKxottj" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YoFJKxottj" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681957925177166042\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YoFJKxottj"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42875 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YoFJKxottj" is_bounded:BOUNDED windowing_strategy_id:"w0@YoFJKxottj"}} windowing_strategies:{key:"w0@YoFJKxottj" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YoFJKxottj" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YoFJKxottj" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YoFJKxottj" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681957925177166042\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YoFJKxottj"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00035c940})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00035c940})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006d6100?, 0xc000136000?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc00012e0c0?}, {0xc000625b60, 0xf}, 0xc000571d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0006d60a0?, 0xc000136000?}, {0xc000050c60, 0x52}, {0x1?}, {0xc000571ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000625b60, 0xf}, {0xc000050c60, 0x52}, {0xf21600, 0xc00046a008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000603380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000603380, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.424s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-023128
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-023128
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:560ab94784f67a0bb96cc3b9f2c07b1485224a5cfe4ce30709dce9815f6926ab
Deleted: sha256:4913f1df2ffbdb11d872f0f011ac9c5b22c042d5bbad29c5e482d9a24d5e9e4b
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-023128
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:560ab94784f67a0bb96cc3b9f2c07b1485224a5cfe4ce30709dce9815f6926ab
Associated tags:
- 20230420-023128
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-023128
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230420-023128].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:560ab94784f67a0bb96cc3b9f2c07b1485224a5cfe4ce30709dce9815f6926ab].
$ rm -rf /tmp/tmp.IFp8xrpu0K
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0583f956e418a95f61660490b5ec87df2305846f4c828bba2bd6fc003f54f38c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0583f956e418a95f61660490b5ec87df2305846f4c828bba2bd6fc003f54f38c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230420022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0583f956e418a95f61660490b5ec87df2305846f4c828bba2bd6fc003f54f38c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0583f956e418a95f61660490b5ec87df2305846f4c828bba2bd6fc003f54f38c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0583f956e418a95f61660490b5ec87df2305846f4c828bba2bd6fc003f54f38c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0583f956e418a95f61660490b5ec87df2305846f4c828bba2bd6fc003f54f38c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:377beefd6ce4bdd1e456055e1339673b3e5cd4224faf7f6776fd547fb5b47cc8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:377beefd6ce4bdd1e456055e1339673b3e5cd4224faf7f6776fd547fb5b47cc8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230420022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:377beefd6ce4bdd1e456055e1339673b3e5cd4224faf7f6776fd547fb5b47cc8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:377beefd6ce4bdd1e456055e1339673b3e5cd4224faf7f6776fd547fb5b47cc8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:377beefd6ce4bdd1e456055e1339673b3e5cd4224faf7f6776fd547fb5b47cc8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:377beefd6ce4bdd1e456055e1339673b3e5cd4224faf7f6776fd547fb5b47cc8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4019269.
Stopping expansion service pid: 4019270.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 21m 31s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/m2tbb5y7k3kj4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1546
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1546/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419202134",
"environmentId": "bkEMXSSvsQbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-203606"
}
]
},
"name": "go-testxlang_partition-597",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/19 21:23:26 Submitted job: 2023-04-19_14_23_25-16443072528446447080
2023/04/19 21:23:26 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-19_14_23_25-16443072528446447080?project=apache-beam-testing
2023/04/19 21:23:26 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-19_14_23_25-16443072528446447080
2023/04/19 21:23:26 Job state: JOB_STATE_PENDING ...
2023/04/19 21:23:56 Job still running ...
2023/04/19 21:24:26 Job still running ...
2023/04/19 21:24:56 Job still running ...
2023/04/19 21:25:26 Job still running ...
2023/04/19 21:25:56 Job still running ...
2023/04/19 21:26:26 Job still running ...
2023/04/19 21:26:56 Job still running ...
2023/04/19 21:27:26 Job still running ...
2023/04/19 21:27:56 Job still running ...
2023/04/19 21:28:26 Job still running ...
2023/04/19 21:28:56 Job still running ...
2023/04/19 21:29:26 Job still running ...
2023/04/19 21:29:56 Job still running ...
2023/04/19 21:30:26 Job still running ...
2023/04/19 21:30:56 Job still running ...
2023/04/19 21:31:26 Job still running ...
2023/04/19 21:31:56 Job still running ...
2023/04/19 21:32:26 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-19_14_23_25-16443072528446447080 failed
--- FAIL: TestXLang_Partition (581.41s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3314.981s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681936665513979265
--- FAIL: TestBigQueryIO_BasicWriteRead (9.65s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39665 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uuQCxTQUzZ" is_bounded:BOUNDED windowing_strategy_id:"w0@uuQCxTQUzZ"}} windowing_strategies:{key:"w0@uuQCxTQUzZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uuQCxTQUzZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uuQCxTQUzZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uuQCxTQUzZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681936665513979265\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uuQCxTQUzZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39665 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uuQCxTQUzZ" is_bounded:BOUNDED windowing_strategy_id:"w0@uuQCxTQUzZ"}} windowing_strategies:{key:"w0@uuQCxTQUzZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uuQCxTQUzZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uuQCxTQUzZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uuQCxTQUzZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681936665513979265\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uuQCxTQUzZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0006ec380})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0006ec380})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000ae1c0?, 0xc0000c4280?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc00064e0c0?}, {0xc00046abf0, 0xf}, 0xc00054bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000ae040?, 0xc0000c4280?}, {0xc0005f44e0, 0x52}, {0x1?}, {0xc00054bea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046abf0, 0xf}, {0xc0005f44e0, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006429c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006429c0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 12.692s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.040s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.063s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-203606
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-203606
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d53f346f349d4dffac94e97eef238b77a083aea2ef8ce7d170d1a7a8d55bbe3e
Deleted: sha256:b38d1c2aebd8d69d2e0f38b871dfa54ace09744f2205474aa22071542ef9f5dd
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-203606
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d53f346f349d4dffac94e97eef238b77a083aea2ef8ce7d170d1a7a8d55bbe3e
Associated tags:
- 20230419-203606
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-203606
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-203606].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d53f346f349d4dffac94e97eef238b77a083aea2ef8ce7d170d1a7a8d55bbe3e].
$ rm -rf /tmp/tmp.Xi2UTo9811
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419202134
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fee670c069e7519ced7239f0609aa9f322ee8855b1e0d27629a8b1f33618240
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419202134]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fee670c069e7519ced7239f0609aa9f322ee8855b1e0d27629a8b1f33618240]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419202134] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fee670c069e7519ced7239f0609aa9f322ee8855b1e0d27629a8b1f33618240])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fee670c069e7519ced7239f0609aa9f322ee8855b1e0d27629a8b1f33618240
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fee670c069e7519ced7239f0609aa9f322ee8855b1e0d27629a8b1f33618240
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8fee670c069e7519ced7239f0609aa9f322ee8855b1e0d27629a8b1f33618240].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419202134
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:571475b70bfd713249ebc033e152f2bf703df33d4bb5e09565ed0448189604d8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419202134]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:571475b70bfd713249ebc033e152f2bf703df33d4bb5e09565ed0448189604d8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419202134] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:571475b70bfd713249ebc033e152f2bf703df33d4bb5e09565ed0448189604d8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:571475b70bfd713249ebc033e152f2bf703df33d4bb5e09565ed0448189604d8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:571475b70bfd713249ebc033e152f2bf703df33d4bb5e09565ed0448189604d8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:571475b70bfd713249ebc033e152f2bf703df33d4bb5e09565ed0448189604d8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3727904.
Stopping expansion service pid: 3727905.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 12m 34s
232 actionable tasks: 169 executed, 53 from cache, 10 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/tnqtvv45cz6qy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1545
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1545/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419142302",
"environmentId": "YisMfLQnPvbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-143359"
}
]
},
"name": "go-testxlang_partition-894",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/19 15:19:34 Submitted job: 2023-04-19_08_19_34-8288524638016435582
2023/04/19 15:19:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-19_08_19_34-8288524638016435582?project=apache-beam-testing
2023/04/19 15:19:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-19_08_19_34-8288524638016435582
2023/04/19 15:19:35 Job state: JOB_STATE_PENDING ...
2023/04/19 15:20:05 Job still running ...
2023/04/19 15:20:35 Job still running ...
2023/04/19 15:21:05 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-19_08_19_34-8288524638016435582 failed
--- FAIL: TestXLang_Partition (131.02s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2825.841s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681914873636878483
--- FAIL: TestBigQueryIO_BasicWriteRead (5.69s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41195 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ixYczavwTA" is_bounded:BOUNDED windowing_strategy_id:"w0@ixYczavwTA"}} windowing_strategies:{key:"w0@ixYczavwTA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ixYczavwTA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ixYczavwTA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ixYczavwTA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681914873636878483\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ixYczavwTA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41195 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ixYczavwTA" is_bounded:BOUNDED windowing_strategy_id:"w0@ixYczavwTA"}} windowing_strategies:{key:"w0@ixYczavwTA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ixYczavwTA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ixYczavwTA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ixYczavwTA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681914873636878483\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ixYczavwTA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0005667c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0005667c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00052afa0?, 0xc0000c4460?}, {0x11c4aa8, 0x39}, {0xc0001580c0?, 0x10c4960?, 0xc000220f60?}, {0xc000489f70, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00052af40?, 0xc0000c4460?}, {0xc00010eba0, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f70, 0xf}, {0xc00010eba0, 0x52}, {0xf21600, 0xc00054b2a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031d860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031d860, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.714s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.050s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-143359
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-143359
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:01323c77b6b3c6fdd5268f50713e07c705e853d062370d2c46a859638cb4d452
Deleted: sha256:fec9ffc9db3a21fcb1e07f48bc517645055cbf3587911584a30d73a52b9290e8
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-143359
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:01323c77b6b3c6fdd5268f50713e07c705e853d062370d2c46a859638cb4d452
Associated tags:
- 20230419-143359
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-143359
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-143359].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:01323c77b6b3c6fdd5268f50713e07c705e853d062370d2c46a859638cb4d452].
$ rm -rf /tmp/tmp.CkWfXkxz1z
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419142302
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b41933befc3a62a03d0404c00dc04e2705a528ee6ef86c02c0eac0e9fe566b5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419142302]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b41933befc3a62a03d0404c00dc04e2705a528ee6ef86c02c0eac0e9fe566b5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419142302] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b41933befc3a62a03d0404c00dc04e2705a528ee6ef86c02c0eac0e9fe566b5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b41933befc3a62a03d0404c00dc04e2705a528ee6ef86c02c0eac0e9fe566b5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b41933befc3a62a03d0404c00dc04e2705a528ee6ef86c02c0eac0e9fe566b5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b41933befc3a62a03d0404c00dc04e2705a528ee6ef86c02c0eac0e9fe566b5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419142302
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70a743b98f6b6b15920c3913c95592e7c35f2da699807f0730c20712de31139b
Deleted: sha256:5af7b0d56722463fe9062039b7ed63ad95fffb563f0e059f1c408d15ca5397f7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419142302]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70a743b98f6b6b15920c3913c95592e7c35f2da699807f0730c20712de31139b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419142302] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70a743b98f6b6b15920c3913c95592e7c35f2da699807f0730c20712de31139b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70a743b98f6b6b15920c3913c95592e7c35f2da699807f0730c20712de31139b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70a743b98f6b6b15920c3913c95592e7c35f2da699807f0730c20712de31139b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:70a743b98f6b6b15920c3913c95592e7c35f2da699807f0730c20712de31139b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 70949.
Stopping expansion service pid: 70950.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 59m 8s
232 actionable tasks: 160 executed, 60 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/qbyqliily35kk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1544
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1544/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419082041",
"environmentId": "UisJhFDTofbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-083142"
}
]
},
"name": "go-testxlang_partition-4",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/19 09:10:55 Submitted job: 2023-04-19_02_10_55-1419549181935679233
2023/04/19 09:10:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-19_02_10_55-1419549181935679233?project=apache-beam-testing
2023/04/19 09:10:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-19_02_10_55-1419549181935679233
2023/04/19 09:10:55 Job state: JOB_STATE_PENDING ...
2023/04/19 09:11:25 Job still running ...
2023/04/19 09:11:55 Job still running ...
2023/04/19 09:12:25 Job still running ...
2023/04/19 09:12:55 Job still running ...
2023/04/19 09:13:25 Job still running ...
2023/04/19 09:13:55 Job still running ...
2023/04/19 09:14:25 Job still running ...
2023/04/19 09:14:55 Job still running ...
2023/04/19 09:15:25 Job still running ...
2023/04/19 09:15:56 Job still running ...
2023/04/19 09:16:26 Job still running ...
2023/04/19 09:16:56 Job still running ...
2023/04/19 09:17:26 Job still running ...
2023/04/19 09:17:56 Job still running ...
2023/04/19 09:18:26 Job still running ...
2023/04/19 09:18:56 Job still running ...
2023/04/19 09:19:26 Job still running ...
2023/04/19 09:19:56 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-19_02_10_55-1419549181935679233 failed
--- FAIL: TestXLang_Partition (580.80s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2892.916s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681893136861795521
--- FAIL: TestBigQueryIO_BasicWriteRead (5.07s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43877 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kfXAqvpuYX" is_bounded:BOUNDED windowing_strategy_id:"w0@kfXAqvpuYX"}} windowing_strategies:{key:"w0@kfXAqvpuYX" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kfXAqvpuYX" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kfXAqvpuYX" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kfXAqvpuYX" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681893136861795521\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kfXAqvpuYX"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43877 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kfXAqvpuYX" is_bounded:BOUNDED windowing_strategy_id:"w0@kfXAqvpuYX"}} windowing_strategies:{key:"w0@kfXAqvpuYX" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kfXAqvpuYX" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kfXAqvpuYX" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kfXAqvpuYX" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681893136861795521\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kfXAqvpuYX"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 51 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00051a080})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00051a080})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000030fa0?, 0xc000658410?}, {0x11c4aa8, 0x39}, {0xc0001580c0?, 0x10c4960?, 0xc000152f60?}, {0xc000489f80, 0xf}, 0xc000217d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000030f40?, 0xc000658410?}, {0xc00010eba0, 0x52}, {0x1?}, {0xc000217ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010eba0, 0x52}, {0xf21600, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031dba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031dba0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.101s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-083142
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-083142
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:448c7470fd6d3a895c3770e136a8a161e3e64fc7fc19f2e65ca436e0aeb000d4
Deleted: sha256:c4325248073beb6f32f79adf50df32e8e3d9d01cf07ee7d882c4407b79ffb9ee
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-083142
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:448c7470fd6d3a895c3770e136a8a161e3e64fc7fc19f2e65ca436e0aeb000d4
Associated tags:
- 20230419-083142
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-083142
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-083142].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:448c7470fd6d3a895c3770e136a8a161e3e64fc7fc19f2e65ca436e0aeb000d4].
$ rm -rf /tmp/tmp.gJ7hRtFgil
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b68a32043f2fc434e7ad9f3b41d18c3e89fc4e4e1489a5d8cbceefe7ad65144
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b68a32043f2fc434e7ad9f3b41d18c3e89fc4e4e1489a5d8cbceefe7ad65144]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b68a32043f2fc434e7ad9f3b41d18c3e89fc4e4e1489a5d8cbceefe7ad65144])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b68a32043f2fc434e7ad9f3b41d18c3e89fc4e4e1489a5d8cbceefe7ad65144
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b68a32043f2fc434e7ad9f3b41d18c3e89fc4e4e1489a5d8cbceefe7ad65144
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6b68a32043f2fc434e7ad9f3b41d18c3e89fc4e4e1489a5d8cbceefe7ad65144].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9fd8b787ee397465358bcf38531dcc89408d9f878b9c8bed93d395ff200bdd6
Deleted: sha256:d9a2d4c36f5f6a5d67cad37f7bf3a1cec860e3caf553b7b95fa8a40155129d72
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9fd8b787ee397465358bcf38531dcc89408d9f878b9c8bed93d395ff200bdd6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9fd8b787ee397465358bcf38531dcc89408d9f878b9c8bed93d395ff200bdd6])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9fd8b787ee397465358bcf38531dcc89408d9f878b9c8bed93d395ff200bdd6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9fd8b787ee397465358bcf38531dcc89408d9f878b9c8bed93d395ff200bdd6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9fd8b787ee397465358bcf38531dcc89408d9f878b9c8bed93d395ff200bdd6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2657516.
Stopping expansion service pid: 2657517.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 15s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ct2yj6r5pxmgo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1543
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1543/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419022029",
"environmentId": "LuvPWomuqnbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-023132"
}
]
},
"name": "go-testxlang_partition-67",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/19 03:16:36 Submitted job: 2023-04-18_20_16_35-3820636135003139564
2023/04/19 03:16:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-18_20_16_35-3820636135003139564?project=apache-beam-testing
2023/04/19 03:16:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-18_20_16_35-3820636135003139564
2023/04/19 03:16:36 Job state: JOB_STATE_PENDING ...
2023/04/19 03:17:06 Job still running ...
2023/04/19 03:17:36 Job still running ...
2023/04/19 03:18:06 Job still running ...
2023/04/19 03:18:36 Job still running ...
2023/04/19 03:19:06 Job still running ...
2023/04/19 03:19:36 Job still running ...
2023/04/19 03:20:06 Job still running ...
2023/04/19 03:20:36 Job still running ...
2023/04/19 03:21:06 Job still running ...
2023/04/19 03:21:36 Job still running ...
2023/04/19 03:22:06 Job still running ...
2023/04/19 03:22:36 Job still running ...
2023/04/19 03:23:06 Job still running ...
2023/04/19 03:23:36 Job still running ...
2023/04/19 03:24:06 Job still running ...
2023/04/19 03:24:36 Job still running ...
2023/04/19 03:25:06 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-18_20_16_35-3820636135003139564 failed
--- FAIL: TestXLang_Partition (551.27s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3213.379s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681871527382829673
--- FAIL: TestBigQueryIO_BasicWriteRead (5.83s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35187 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PmmbtKowRv" is_bounded:BOUNDED windowing_strategy_id:"w0@PmmbtKowRv"}} windowing_strategies:{key:"w0@PmmbtKowRv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PmmbtKowRv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PmmbtKowRv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PmmbtKowRv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681871527382829673\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PmmbtKowRv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35187 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PmmbtKowRv" is_bounded:BOUNDED windowing_strategy_id:"w0@PmmbtKowRv"}} windowing_strategies:{key:"w0@PmmbtKowRv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PmmbtKowRv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PmmbtKowRv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PmmbtKowRv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681871527382829673\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PmmbtKowRv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 24 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0004d8a80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0004d8a80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e0e0?, 0xc000160050?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc00058e0c0?}, {0xc00046db50, 0xf}, 0xc000219d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e080?, 0xc000160050?}, {0xc000050cc0, 0x52}, {0x1?}, {0xc000219ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046db50, 0xf}, {0xc000050cc0, 0x52}, {0xf21600, 0xc0001360f8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d7860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d7860, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.856s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.045s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6e846e7fa310e9a1d1227432e6515b7bc910a811672274d0aa2d60e2f07e5814
Associated tags:
- 20230419-023132
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-023132
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230419-023132].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6e846e7fa310e9a1d1227432e6515b7bc910a811672274d0aa2d60e2f07e5814].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419022029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b30c67d13bd7ed902e0a040a0f7d8b47fb467961d2af71537a70ab4527d0c332]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230419022029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b30c67d13bd7ed902e0a040a0f7d8b47fb467961d2af71537a70ab4527d0c332])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b30c67d13bd7ed902e0a040a0f7d8b47fb467961d2af71537a70ab4527d0c332
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b30c67d13bd7ed902e0a040a0f7d8b47fb467961d2af71537a70ab4527d0c332].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419022029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a59d49f804fd909aa731245defaa00c1b18c7822ac3f192f0694b0b3d59f93c6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230419022029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a59d49f804fd909aa731245defaa00c1b18c7822ac3f192f0694b0b3d59f93c6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a59d49f804fd909aa731245defaa00c1b18c7822ac3f192f0694b0b3d59f93c6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a59d49f804fd909aa731245defaa00c1b18c7822ac3f192f0694b0b3d59f93c6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 35s
232 actionable tasks: 173 executed, 49 from cache, 10 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/4vlettsen4r64
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1542
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1542/display/redirect?page=changes>
Changes:
[noreply] Add timeout to a couple of validate runner tests (#26304)
------------------------------------------
[...truncated 549.76 KB...]
#16 1.734 opt-einsum==3.3.0
#16 1.734 orjson==3.8.9
#16 1.734 overrides==6.5.0
#16 1.734 packaging==23.0
#16 1.734 pandas==1.5.3
#16 1.734 parameterized==0.8.1
#16 1.734 pip==23.1
#16 1.734 pluggy==1.0.0
#16 1.734 proto-plus==1.22.2
#16 1.734 protobuf==4.22.1
#16 1.734 psycopg2-binary==2.9.6
#16 1.734 pyarrow==11.0.0
#16 1.734 pyasn1==0.4.8
#16 1.734 pyasn1-modules==0.2.8
#16 1.734 pycparser==2.21
#16 1.734 pydot==1.4.2
#16 1.734 PyHamcrest==1.10.1
#16 1.734 pymongo==4.3.3
#16 1.734 PyMySQL==1.0.3
#16 1.734 pyparsing==3.0.9
#16 1.734 pytest==7.2.2
#16 1.734 pytest-timeout==2.1.0
#16 1.734 pytest-xdist==3.2.1
#16 1.734 python-dateutil==2.8.2
#16 1.734 python-snappy==0.6.1
#16 1.734 pytz==2023.3
#16 1.734 PyYAML==6.0
#16 1.734 regex==2023.3.23
#16 1.734 requests==2.28.2
#16 1.734 requests-mock==1.10.0
#16 1.734 requests-oauthlib==1.3.1
#16 1.734 rsa==4.9
#16 1.734 scikit-learn==1.2.2
#16 1.734 scipy==1.10.1
#16 1.734 setuptools==67.6.1
#16 1.734 six==1.16.0
#16 1.734 sortedcontainers==2.4.0
#16 1.734 soupsieve==2.4
#16 1.734 SQLAlchemy==1.4.47
#16 1.734 sqlparse==0.4.3
#16 1.734 tenacity==8.2.2
#16 1.734 tensorboard==2.12.1
#16 1.734 tensorboard-data-server==0.7.0
#16 1.734 tensorboard-plugin-wit==1.8.1
#16 1.734 tensorflow==2.12.0
#16 1.734 tensorflow-estimator==2.12.0
#16 1.734 tensorflow-io-gcs-filesystem==0.32.0
#16 1.734 termcolor==2.2.0
#16 1.734 testcontainers==3.7.1
#16 1.734 threadpoolctl==3.1.0
#16 1.734 tomli==2.0.1
#16 1.734 tqdm==4.65.0
#16 1.734 typing_extensions==4.5.0
#16 1.734 urllib3==1.26.15
#16 1.734 websocket-client==1.5.1
#16 1.734 Werkzeug==2.2.3
#16 1.734 wheel==0.40.0
#16 1.734 wrapt==1.14.1
#16 1.734 zipp==3.15.0
#16 1.734 zstandard==0.20.0
#16 DONE 1.9s
#17 [beam 13/16] COPY target/LICENSE /opt/apache/beam/
#17 DONE 0.1s
#18 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/
#18 DONE 0.1s
#19 [beam 15/16] COPY target/NOTICE /opt/apache/beam/
#19 DONE 0.1s
#20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/
#20 DONE 0.1s
#21 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#21 DONE 0.1s
#22 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#22 DONE 0.1s
#23 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#23 DONE 0.1s
#24 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#24 1.714 Collecting pip-licenses<5
#24 1.783 Downloading pip_licenses-4.2.0-py3-none-any.whl (19 kB)
#24 1.793 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0)
#24 1.794 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#24 1.874 Collecting prettytable>=2.3.0 (from pip-licenses<5)
#24 1.892 Downloading prettytable-3.7.0-py3-none-any.whl (27 kB)
#24 1.970 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5)
#24 1.987 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#24 3.808 Installing collected packages: wcwidth, prettytable, pip-licenses
#24 4.050 Successfully installed pip-licenses-4.2.0 prettytable-3.7.0 wcwidth-0.2.6
#24 4.051 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#24 14.39 INFO:root:Successfully pulled licenses for 133 dependencies
#24 14.39 Skip pulling license for bs4
#24 DONE 15.7s
#25 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#25 DONE 0.2s
#26 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#26 DONE 1.2s
#27 exporting to image
#27 exporting layers
#27 exporting layers 26.7s done
#27 writing image sha256:6e4c216df347ce13e7222fbeae51751606ed88da8d3fb85421e7f9d077a91f35 done
#27 naming to docker.io/apache/beam_python3.8_sdk:2.48.0.dev done
#27 DONE 26.7s
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
79e65962b105: Preparing
9b1f1a28e713: Preparing
f032f684e740: Preparing
2c1287091e71: Preparing
c8062fd1d0fb: Preparing
caaca2d48830: Preparing
bf59dc31081b: Preparing
5ec2b4c25583: Preparing
3572f2c2feef: Preparing
0554dce7baa3: Preparing
e680ce5b4ca9: Preparing
cce9977b69c7: Preparing
46e7229ad7c8: Preparing
67bcb27de5e9: Preparing
da996804ce37: Preparing
021c215d5d76: Preparing
0ccc9c4eda09: Preparing
08d72d88859a: Preparing
01436069ffa9: Preparing
1565a29432a5: Preparing
807e5e673844: Preparing
cfd0811d364e: Preparing
b86f260e173a: Preparing
6a1ebb98b0dc: Preparing
24b48387f467: Preparing
ae56c0c5405b: Preparing
807e5e673844: Waiting
cfd0811d364e: Waiting
b86f260e173a: Waiting
5ec2b4c25583: Waiting
3572f2c2feef: Waiting
0554dce7baa3: Waiting
67bcb27de5e9: Waiting
da996804ce37: Waiting
0ccc9c4eda09: Waiting
08d72d88859a: Waiting
021c215d5d76: Waiting
e680ce5b4ca9: Waiting
01436069ffa9: Waiting
1565a29432a5: Waiting
caaca2d48830: Waiting
6a1ebb98b0dc: Waiting
24b48387f467: Waiting
ae56c0c5405b: Waiting
cce9977b69c7: Waiting
bf59dc31081b: Waiting
46e7229ad7c8: Waiting
2c1287091e71: Pushed
9b1f1a28e713: Pushed
c8062fd1d0fb: Pushed
f032f684e740: Pushed
caaca2d48830: Pushed
bf59dc31081b: Pushed
5ec2b4c25583: Pushed
79e65962b105: Pushed
0554dce7baa3: Pushed
cce9977b69c7: Pushed
e680ce5b4ca9: Pushed
021c215d5d76: Pushed
67bcb27de5e9: Pushed
08d72d88859a: Layer already exists
01436069ffa9: Layer already exists
0ccc9c4eda09: Pushed
1565a29432a5: Layer already exists
807e5e673844: Layer already exists
cfd0811d364e: Layer already exists
b86f260e173a: Layer already exists
6a1ebb98b0dc: Layer already exists
ae56c0c5405b: Layer already exists
24b48387f467: Layer already exists
3572f2c2feef: Pushed
46e7229ad7c8: Pushed
da996804ce37: Pushed
20230418202212: digest: sha256:c5ee14df79970e88dcf3dc26b6de21f2fa9d94a2ed939d34a93c03daa339ba5d size: 5774
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:core:generateGrammarSource'.
> Failed to load cache entry 0d7440665cff7f9bec6a90f532c5c0bf for task ':sdks:java:core:generateGrammarSource': Could not load from local cache: Timeout waiting to lock Build cache (/home/jenkins/.gradle/caches/build-cache-1). It is currently in use by another Gradle instance.
Owner PID: 3939818
Our PID: 3994671
Owner Operation:
Our operation:
Lock file: /home/jenkins/.gradle/caches/build-cache-1/build-cache-1.lock
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 19m 12s
132 actionable tasks: 99 executed, 21 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/gyfnkgjhxeb6w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1541
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1541/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-143425",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-143425"
}
]
},
"name": "go-testxlang_partition-445",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/18 15:13:16 Submitted job: 2023-04-18_08_13_16-10812898130377977186
2023/04/18 15:13:16 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-18_08_13_16-10812898130377977186?project=apache-beam-testing
2023/04/18 15:13:16 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-18_08_13_16-10812898130377977186
2023/04/18 15:13:16 Job state: JOB_STATE_PENDING ...
2023/04/18 15:13:46 Job still running ...
2023/04/18 15:14:17 Job still running ...
2023/04/18 15:14:47 Job still running ...
2023/04/18 15:15:17 Job still running ...
2023/04/18 15:15:47 Job still running ...
2023/04/18 15:16:17 Job still running ...
2023/04/18 15:16:47 Job still running ...
2023/04/18 15:17:17 Job still running ...
2023/04/18 15:17:47 Job still running ...
2023/04/18 15:18:17 Job still running ...
2023/04/18 15:18:47 Job still running ...
2023/04/18 15:19:17 Job still running ...
2023/04/18 15:19:47 Job still running ...
2023/04/18 15:20:17 Job still running ...
2023/04/18 15:20:47 Job still running ...
2023/04/18 15:21:17 Job still running ...
2023/04/18 15:21:47 Job still running ...
2023/04/18 15:22:17 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-18_08_13_16-10812898130377977186 failed
--- FAIL: TestXLang_Partition (582.99s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2769.629s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681828603844667737
--- FAIL: TestBigQueryIO_BasicWriteRead (6.68s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43317 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KoNJjaBFGP" is_bounded:BOUNDED windowing_strategy_id:"w0@KoNJjaBFGP"}} windowing_strategies:{key:"w0@KoNJjaBFGP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KoNJjaBFGP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KoNJjaBFGP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KoNJjaBFGP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681828603844667737\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KoNJjaBFGP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43317 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KoNJjaBFGP" is_bounded:BOUNDED windowing_strategy_id:"w0@KoNJjaBFGP"}} windowing_strategies:{key:"w0@KoNJjaBFGP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KoNJjaBFGP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KoNJjaBFGP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KoNJjaBFGP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681828603844667737\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KoNJjaBFGP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc000522f40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc000522f40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004fc420?, 0xc000514500?}, {0x11c4aa8, 0x39}, {0xc000158180?, 0x10c4960?, 0xc0004eea20?}, {0xc0000440a0, 0xf}, 0xc000217d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004fc3c0?, 0xc000514500?}, {0xc00051c3c0, 0x52}, {0x1?}, {0xc000217ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440a0, 0xf}, {0xc00051c3c0, 0x52}, {0xf21600, 0xc0000453d0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005824e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005824e0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.719s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.155s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0598503bb387a340b11956093f79b1a207393ab6fa0e9c63104dff972b9af58c
Associated tags:
- 20230418-143425
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-143425
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-143425].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0598503bb387a340b11956093f79b1a207393ab6fa0e9c63104dff972b9af58c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230418142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cfc4eb2947b75c962644c24a4283fab29904b624981c7666af759c0bf11bcedd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230418142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cfc4eb2947b75c962644c24a4283fab29904b624981c7666af759c0bf11bcedd])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cfc4eb2947b75c962644c24a4283fab29904b624981c7666af759c0bf11bcedd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cfc4eb2947b75c962644c24a4283fab29904b624981c7666af759c0bf11bcedd].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abac0187903d9a54f73002bd807ae854ac8fbc0841d3ea16848df172235795f7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abac0187903d9a54f73002bd807ae854ac8fbc0841d3ea16848df172235795f7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abac0187903d9a54f73002bd807ae854ac8fbc0841d3ea16848df172235795f7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abac0187903d9a54f73002bd807ae854ac8fbc0841d3ea16848df172235795f7].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 34s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
Publishing build scan failed due to network error 'java.net.SocketException: Unexpected end of file from server' (2 retries remaining)...
Publishing build scan failed due to network error 'java.net.SocketException: Unexpected end of file from server' (1 retry remaining)...
A network error occurred.
If you require assistance with this problem, please report it via https://gradle.com/help/plugin and include the following information via copy/paste.
----------
Gradle version: 7.5.1
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: e711db22-81f6-4e9a-b09b-18e197754581
Exception: java.net.SocketException: Unexpected end of file from server
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1540
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1540/display/redirect>
Changes:
------------------------------------------
[...truncated 1.06 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418082118",
"environmentId": "XQcygprgIybeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-083520"
}
]
},
"name": "go-testxlang_partition-671",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/18 09:23:34 Submitted job: 2023-04-18_02_23_33-5183682785808948220
2023/04/18 09:23:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-18_02_23_33-5183682785808948220?project=apache-beam-testing
2023/04/18 09:23:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-18_02_23_33-5183682785808948220
2023/04/18 09:23:34 Job state: JOB_STATE_PENDING ...
2023/04/18 09:24:04 Job still running ...
2023/04/18 09:24:34 Job still running ...
2023/04/18 09:25:04 Job still running ...
2023/04/18 09:25:34 Job still running ...
2023/04/18 09:26:04 Job still running ...
2023/04/18 09:26:34 Job still running ...
2023/04/18 09:27:04 Job still running ...
2023/04/18 09:27:34 Job still running ...
2023/04/18 09:28:04 Job still running ...
2023/04/18 09:28:34 Job still running ...
2023/04/18 09:29:04 Job still running ...
2023/04/18 09:29:34 Job still running ...
2023/04/18 09:30:04 Job still running ...
2023/04/18 09:30:34 Job still running ...
2023/04/18 09:31:04 Job still running ...
2023/04/18 09:31:34 Job still running ...
2023/04/18 09:32:04 Job still running ...
2023/04/18 09:32:34 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-18_02_23_33-5183682785808948220 failed
--- FAIL: TestXLang_Partition (587.73s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3385.708s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681807003689216142
--- FAIL: TestBigQueryIO_BasicWriteRead (10.17s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40555 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IyvIHreDHy" is_bounded:BOUNDED windowing_strategy_id:"w0@IyvIHreDHy"}} windowing_strategies:{key:"w0@IyvIHreDHy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IyvIHreDHy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IyvIHreDHy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IyvIHreDHy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681807003689216142\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IyvIHreDHy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40555 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IyvIHreDHy" is_bounded:BOUNDED windowing_strategy_id:"w0@IyvIHreDHy"}} windowing_strategies:{key:"w0@IyvIHreDHy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IyvIHreDHy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IyvIHreDHy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IyvIHreDHy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681807003689216142\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IyvIHreDHy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 33 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00017c780})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00017c780})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000114080?, 0xc0000c4280?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc00010e0c0?}, {0xc00053bde0, 0xf}, 0xc0006a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000114020?, 0xc0000c4280?}, {0xc000574780, 0x52}, {0x1?}, {0xc0006a9ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00053bde0, 0xf}, {0xc000574780, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001029c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001029c0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 13.258s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.101s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.125s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.112s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-083520
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-083520
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:36e1944ccd94871898edaa8ded3a233feefec74a3010a07bc5b0ea7e126c6bcb
Deleted: sha256:ac50e3c2fe2be61ffb61500e595dbfd1bb78e7be96dd14c903bfd6418d587df4
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-083520
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:36e1944ccd94871898edaa8ded3a233feefec74a3010a07bc5b0ea7e126c6bcb
Associated tags:
- 20230418-083520
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-083520
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-083520].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:36e1944ccd94871898edaa8ded3a233feefec74a3010a07bc5b0ea7e126c6bcb].
$ rm -rf /tmp/tmp.05HjtHlyax
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230418082118
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:331692fae2ef252432a084d0d4aab288bf6722c9434947a602fce66d1a93da12
Deleted: sha256:72ad94db94d5e4ebeb245dd66e0ffaf211fb1195f2355587e6600eec3238d347
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230418082118]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:331692fae2ef252432a084d0d4aab288bf6722c9434947a602fce66d1a93da12]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230418082118] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:331692fae2ef252432a084d0d4aab288bf6722c9434947a602fce66d1a93da12])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:331692fae2ef252432a084d0d4aab288bf6722c9434947a602fce66d1a93da12
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:331692fae2ef252432a084d0d4aab288bf6722c9434947a602fce66d1a93da12
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:331692fae2ef252432a084d0d4aab288bf6722c9434947a602fce66d1a93da12].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418082118
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34d7ddc3a0e151db5ed5e8e561de3d6a2a1446222de158afd59ddcd493720a5d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418082118]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34d7ddc3a0e151db5ed5e8e561de3d6a2a1446222de158afd59ddcd493720a5d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418082118] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34d7ddc3a0e151db5ed5e8e561de3d6a2a1446222de158afd59ddcd493720a5d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34d7ddc3a0e151db5ed5e8e561de3d6a2a1446222de158afd59ddcd493720a5d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34d7ddc3a0e151db5ed5e8e561de3d6a2a1446222de158afd59ddcd493720a5d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34d7ddc3a0e151db5ed5e8e561de3d6a2a1446222de158afd59ddcd493720a5d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 744358.
Stopping expansion service pid: 744359.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 13m 1s
232 actionable tasks: 166 executed, 54 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/batszeudwn574
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1539
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1539/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418022039",
"environmentId": "GcFZZTUauXbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-023130"
}
]
},
"name": "go-testxlang_partition-934",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/18 03:17:48 Submitted job: 2023-04-17_20_17_48-13724415643795131427
2023/04/18 03:17:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-17_20_17_48-13724415643795131427?project=apache-beam-testing
2023/04/18 03:17:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-17_20_17_48-13724415643795131427
2023/04/18 03:17:48 Job state: JOB_STATE_PENDING ...
2023/04/18 03:18:18 Job still running ...
2023/04/18 03:18:48 Job still running ...
2023/04/18 03:19:18 Job still running ...
2023/04/18 03:19:48 Job still running ...
2023/04/18 03:20:18 Job still running ...
2023/04/18 03:20:48 Job still running ...
2023/04/18 03:21:18 Job still running ...
2023/04/18 03:21:48 Job still running ...
2023/04/18 03:22:18 Job still running ...
2023/04/18 03:22:48 Job still running ...
2023/04/18 03:23:18 Job still running ...
2023/04/18 03:23:48 Job still running ...
2023/04/18 03:24:18 Job still running ...
2023/04/18 03:24:49 Job still running ...
2023/04/18 03:25:19 Job still running ...
2023/04/18 03:25:49 Job still running ...
2023/04/18 03:26:19 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-17_20_17_48-13724415643795131427 failed
--- FAIL: TestXLang_Partition (550.47s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3283.600s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681785129657920941
--- FAIL: TestBigQueryIO_BasicWriteRead (6.19s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45027 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@fkVEVYTEWK" is_bounded:BOUNDED windowing_strategy_id:"w0@fkVEVYTEWK"}} windowing_strategies:{key:"w0@fkVEVYTEWK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@fkVEVYTEWK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@fkVEVYTEWK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@fkVEVYTEWK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681785129657920941\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"fkVEVYTEWK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45027 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@fkVEVYTEWK" is_bounded:BOUNDED windowing_strategy_id:"w0@fkVEVYTEWK"}} windowing_strategies:{key:"w0@fkVEVYTEWK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@fkVEVYTEWK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@fkVEVYTEWK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@fkVEVYTEWK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681785129657920941\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"fkVEVYTEWK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 15 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0004906c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0004906c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00012e080?, 0xc000130000?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc0001240c0?}, {0xc0006dbde0, 0xf}, 0xc000205d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00012e020?, 0xc000130000?}, {0xc000050de0, 0x52}, {0x1?}, {0xc000205ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0006dbde0, 0xf}, {0xc000050de0, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103380, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.221s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:132f7ac2a21fa39c59a817abbd160d64efe7d457600fabc4401dccea3f2fe61e
Associated tags:
- 20230418-023130
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-023130
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230418-023130].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:132f7ac2a21fa39c59a817abbd160d64efe7d457600fabc4401dccea3f2fe61e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230418022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b83abd9a360659ea55468a21607dfab2976f6ccb28452aa7e254ed12c0c4f2e7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230418022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b83abd9a360659ea55468a21607dfab2976f6ccb28452aa7e254ed12c0c4f2e7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b83abd9a360659ea55468a21607dfab2976f6ccb28452aa7e254ed12c0c4f2e7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b83abd9a360659ea55468a21607dfab2976f6ccb28452aa7e254ed12c0c4f2e7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8d7e25ac738cf83b697e9d3e46d843ab9f74149d34001b68e2de382c3b8126de]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230418022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8d7e25ac738cf83b697e9d3e46d843ab9f74149d34001b68e2de382c3b8126de])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8d7e25ac738cf83b697e9d3e46d843ab9f74149d34001b68e2de382c3b8126de
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8d7e25ac738cf83b697e9d3e46d843ab9f74149d34001b68e2de382c3b8126de].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 36s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/wwedqdijdw3rs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1538
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1538/display/redirect>
Changes:
------------------------------------------
[...truncated 1023.22 KB...]
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-202932",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-202932"
}
]
},
"name": "go-testxlang_partition-935",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/17 21:16:25 Submitted job: 2023-04-17_14_16_24-4179361525543200334
2023/04/17 21:16:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-17_14_16_24-4179361525543200334?project=apache-beam-testing
2023/04/17 21:16:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-17_14_16_24-4179361525543200334
2023/04/17 21:16:25 Job state: JOB_STATE_PENDING ...
2023/04/17 21:16:55 Job still running ...
2023/04/17 21:17:25 Job still running ...
2023/04/17 21:17:55 Job still running ...
2023/04/17 21:18:25 Job still running ...
2023/04/17 21:18:55 Job still running ...
2023/04/17 21:19:25 Job still running ...
2023/04/17 21:19:55 Job still running ...
2023/04/17 21:20:25 Job still running ...
2023/04/17 21:20:55 Job still running ...
2023/04/17 21:21:26 Job still running ...
2023/04/17 21:21:56 Job still running ...
2023/04/17 21:22:26 Job still running ...
2023/04/17 21:22:56 Job still running ...
2023/04/17 21:23:26 Job still running ...
2023/04/17 21:23:56 Job still running ...
2023/04/17 21:24:26 Job still running ...
2023/04/17 21:24:56 Job still running ...
2023/04/17 21:25:26 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-17_14_16_24-4179361525543200334 failed
--- FAIL: TestXLang_Partition (581.10s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3340.179s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681763419384957561
--- FAIL: TestBigQueryIO_BasicWriteRead (6.71s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41579 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xrLbJZFujv" is_bounded:BOUNDED windowing_strategy_id:"w0@xrLbJZFujv"}} windowing_strategies:{key:"w0@xrLbJZFujv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xrLbJZFujv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xrLbJZFujv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xrLbJZFujv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681763419384957561\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xrLbJZFujv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41579 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xrLbJZFujv" is_bounded:BOUNDED windowing_strategy_id:"w0@xrLbJZFujv"}} windowing_strategies:{key:"w0@xrLbJZFujv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xrLbJZFujv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xrLbJZFujv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xrLbJZFujv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681763419384957561\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xrLbJZFujv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00016a380})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00016a380})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005b6080?, 0xc0005ba000?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc0005ac0c0?}, {0xc0003edee0, 0xf}, 0xc000125d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005b6020?, 0xc0005ba000?}, {0xc000050de0, 0x52}, {0x1?}, {0xc000125ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003edee0, 0xf}, {0xc000050de0, 0x52}, {0xf21600, 0xc0005b8008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000583d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000583d40, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.748s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.228s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.047s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-202932
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-202932
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f50533edf00d15d2a01d76e6d4c64782d269e7811603ca34ba765fde11201cbd
Deleted: sha256:2eaf42a8ae4a321963dbd0eee555ec146ad69e3d89c4e6f8aa8d64f5cc366a86
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-202932
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f50533edf00d15d2a01d76e6d4c64782d269e7811603ca34ba765fde11201cbd
Associated tags:
- 20230417-202932
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-202932
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-202932].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f50533edf00d15d2a01d76e6d4c64782d269e7811603ca34ba765fde11201cbd].
$ rm -rf /tmp/tmp.KD9SZNOIbd
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417202046
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:00c2669adf51c3f6d6c75a01f3d137fced4a93a93f43b857dbf5b6321a2b6544
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417202046]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:00c2669adf51c3f6d6c75a01f3d137fced4a93a93f43b857dbf5b6321a2b6544]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417202046] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:00c2669adf51c3f6d6c75a01f3d137fced4a93a93f43b857dbf5b6321a2b6544])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:00c2669adf51c3f6d6c75a01f3d137fced4a93a93f43b857dbf5b6321a2b6544
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:00c2669adf51c3f6d6c75a01f3d137fced4a93a93f43b857dbf5b6321a2b6544
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:00c2669adf51c3f6d6c75a01f3d137fced4a93a93f43b857dbf5b6321a2b6544].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417202046
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e46ed5c3b3824d19c3656facb2fc2c10ccf084500f03e28290054dbaa18eef3f
Deleted: sha256:5474478cc37ee544e89da15a99b590bf4bbacc83169fb0b789b50dab18da7838
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417202046]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e46ed5c3b3824d19c3656facb2fc2c10ccf084500f03e28290054dbaa18eef3f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417202046] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e46ed5c3b3824d19c3656facb2fc2c10ccf084500f03e28290054dbaa18eef3f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e46ed5c3b3824d19c3656facb2fc2c10ccf084500f03e28290054dbaa18eef3f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e46ed5c3b3824d19c3656facb2fc2c10ccf084500f03e28290054dbaa18eef3f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e46ed5c3b3824d19c3656facb2fc2c10ccf084500f03e28290054dbaa18eef3f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4074242.
Stopping expansion service pid: 4074243.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 42s
232 actionable tasks: 161 executed, 59 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/dgwomgvz7az4i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1537
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1537/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417142044",
"environmentId": "TjeVTJMsoVbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-143235"
}
]
},
"name": "go-testxlang_partition-635",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/17 15:17:39 Submitted job: 2023-04-17_08_17_38-1620474232384262060
2023/04/17 15:17:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-17_08_17_38-1620474232384262060?project=apache-beam-testing
2023/04/17 15:17:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-17_08_17_38-1620474232384262060
2023/04/17 15:17:39 Job state: JOB_STATE_PENDING ...
2023/04/17 15:18:09 Job still running ...
2023/04/17 15:18:39 Job still running ...
2023/04/17 15:19:09 Job still running ...
2023/04/17 15:19:39 Job still running ...
2023/04/17 15:20:09 Job still running ...
2023/04/17 15:20:39 Job still running ...
2023/04/17 15:21:09 Job still running ...
2023/04/17 15:21:39 Job still running ...
2023/04/17 15:22:09 Job still running ...
2023/04/17 15:22:39 Job still running ...
2023/04/17 15:23:09 Job still running ...
2023/04/17 15:23:40 Job still running ...
2023/04/17 15:24:10 Job still running ...
2023/04/17 15:24:40 Job still running ...
2023/04/17 15:25:10 Job still running ...
2023/04/17 15:25:40 Job still running ...
2023/04/17 15:26:10 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-17_08_17_38-1620474232384262060 failed
--- FAIL: TestXLang_Partition (551.85s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3213.428s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681741990264991050
--- FAIL: TestBigQueryIO_BasicWriteRead (4.60s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46719 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aZjUWCBEog" is_bounded:BOUNDED windowing_strategy_id:"w0@aZjUWCBEog"}} windowing_strategies:{key:"w0@aZjUWCBEog" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aZjUWCBEog" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aZjUWCBEog" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aZjUWCBEog" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681741990264991050\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aZjUWCBEog"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46719 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aZjUWCBEog" is_bounded:BOUNDED windowing_strategy_id:"w0@aZjUWCBEog"}} windowing_strategies:{key:"w0@aZjUWCBEog" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aZjUWCBEog" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aZjUWCBEog" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aZjUWCBEog" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681741990264991050\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aZjUWCBEog"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0005a0900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0005a0900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00070c100?, 0xc000172000?}, {0x11c4aa8, 0x39}, {0xc0000f60c0?, 0x10c4960?, 0xc00016a0c0?}, {0xc00013fb70, 0xf}, 0xc000567d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00070c0a0?, 0xc000172000?}, {0xc0007287e0, 0x52}, {0x1?}, {0xc000567ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00013fb70, 0xf}, {0xc0007287e0, 0x52}, {0xf21600, 0xc000702298})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103a00, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.636s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-143235
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-143235
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cbaaf6b695e33b863aae8712b57f9637fb4ad5440266b30575f0db47a24c4128
Deleted: sha256:6ff83434a362e175d34b1a28fd97b1fdb7d88290d08599d79a964120f6f65dee
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-143235
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cbaaf6b695e33b863aae8712b57f9637fb4ad5440266b30575f0db47a24c4128
Associated tags:
- 20230417-143235
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-143235
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-143235].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cbaaf6b695e33b863aae8712b57f9637fb4ad5440266b30575f0db47a24c4128].
$ rm -rf /tmp/tmp.rgb09hjWfY
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417142044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:43a903c01804ca20e9137978205e1b829e356015743f7b66aaf2a50c1865b351
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:43a903c01804ca20e9137978205e1b829e356015743f7b66aaf2a50c1865b351]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:43a903c01804ca20e9137978205e1b829e356015743f7b66aaf2a50c1865b351])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:43a903c01804ca20e9137978205e1b829e356015743f7b66aaf2a50c1865b351
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:43a903c01804ca20e9137978205e1b829e356015743f7b66aaf2a50c1865b351
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:43a903c01804ca20e9137978205e1b829e356015743f7b66aaf2a50c1865b351].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417142044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22fc63001b3662a6a3b9a37107069277d00c301345342a79a21beffd8479a946
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22fc63001b3662a6a3b9a37107069277d00c301345342a79a21beffd8479a946]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22fc63001b3662a6a3b9a37107069277d00c301345342a79a21beffd8479a946])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22fc63001b3662a6a3b9a37107069277d00c301345342a79a21beffd8479a946
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22fc63001b3662a6a3b9a37107069277d00c301345342a79a21beffd8479a946
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22fc63001b3662a6a3b9a37107069277d00c301345342a79a21beffd8479a946].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2356038.
Stopping expansion service pid: 2356039.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 26s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/przuo2emtw7ok
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1536
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1536/display/redirect?page=changes>
Changes:
[noreply] [AWS] Support usage of StsAssumeRoleWithWebIdentityCredentialsProvider
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417082030",
"environmentId": "bWrBFKdoWPbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-083117"
}
]
},
"name": "go-testxlang_partition-237",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/17 09:16:41 Submitted job: 2023-04-17_02_16_40-2179880329942738599
2023/04/17 09:16:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-17_02_16_40-2179880329942738599?project=apache-beam-testing
2023/04/17 09:16:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-17_02_16_40-2179880329942738599
2023/04/17 09:16:41 Job state: JOB_STATE_PENDING ...
2023/04/17 09:17:11 Job still running ...
2023/04/17 09:17:41 Job still running ...
2023/04/17 09:18:11 Job still running ...
2023/04/17 09:18:41 Job still running ...
2023/04/17 09:19:11 Job still running ...
2023/04/17 09:19:41 Job still running ...
2023/04/17 09:20:11 Job still running ...
2023/04/17 09:20:41 Job still running ...
2023/04/17 09:21:11 Job still running ...
2023/04/17 09:21:41 Job still running ...
2023/04/17 09:22:11 Job still running ...
2023/04/17 09:22:41 Job still running ...
2023/04/17 09:23:12 Job still running ...
2023/04/17 09:23:42 Job still running ...
2023/04/17 09:24:12 Job still running ...
2023/04/17 09:24:42 Job still running ...
2023/04/17 09:25:12 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-17_02_16_40-2179880329942738599 failed
--- FAIL: TestXLang_Partition (550.41s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3234.715s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681720310744675946
--- FAIL: TestBigQueryIO_BasicWriteRead (4.43s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44197 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LhgyYtWZXv" is_bounded:BOUNDED windowing_strategy_id:"w0@LhgyYtWZXv"}} windowing_strategies:{key:"w0@LhgyYtWZXv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LhgyYtWZXv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LhgyYtWZXv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LhgyYtWZXv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681720310744675946\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LhgyYtWZXv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44197 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LhgyYtWZXv" is_bounded:BOUNDED windowing_strategy_id:"w0@LhgyYtWZXv"}} windowing_strategies:{key:"w0@LhgyYtWZXv" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LhgyYtWZXv" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LhgyYtWZXv" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@LhgyYtWZXv" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681720310744675946\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LhgyYtWZXv"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 37 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc000206700})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc000206700})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0006200a0?, 0xc000520000?}, {0x11c4aa8, 0x39}, {0xc000544000?, 0x10c4960?, 0xc0005180c0?}, {0xc00046de10, 0xf}, 0xc000177d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000620040?, 0xc000520000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc000177ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050e40, 0x52}, {0xf21600, 0xc00061a028})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d7860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d7860, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.459s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-083117
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-083117
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1544147fbb477fd50b184f8ceb91eb6f2a9510b1dc2846b4c5ac4c002627c733
Deleted: sha256:1af0fbae95994b5de4374a8a8551bfd904851f146d465230827311c1f6bee58f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-083117
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1544147fbb477fd50b184f8ceb91eb6f2a9510b1dc2846b4c5ac4c002627c733
Associated tags:
- 20230417-083117
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-083117
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-083117].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1544147fbb477fd50b184f8ceb91eb6f2a9510b1dc2846b4c5ac4c002627c733].
$ rm -rf /tmp/tmp.UYvL1rfqLp
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417082030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bad706a9b03eca7fdf3ab8aea7aab1adb36958938996eb180ccbbcc90ce1318
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417082030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bad706a9b03eca7fdf3ab8aea7aab1adb36958938996eb180ccbbcc90ce1318]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417082030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bad706a9b03eca7fdf3ab8aea7aab1adb36958938996eb180ccbbcc90ce1318])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bad706a9b03eca7fdf3ab8aea7aab1adb36958938996eb180ccbbcc90ce1318
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bad706a9b03eca7fdf3ab8aea7aab1adb36958938996eb180ccbbcc90ce1318
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bad706a9b03eca7fdf3ab8aea7aab1adb36958938996eb180ccbbcc90ce1318].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417082030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:18b754f06a9ebe82325e4a6f6d99910d3d32b9151f38c88c86faf2b4bca4ec9b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417082030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:18b754f06a9ebe82325e4a6f6d99910d3d32b9151f38c88c86faf2b4bca4ec9b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417082030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:18b754f06a9ebe82325e4a6f6d99910d3d32b9151f38c88c86faf2b4bca4ec9b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:18b754f06a9ebe82325e4a6f6d99910d3d32b9151f38c88c86faf2b4bca4ec9b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:18b754f06a9ebe82325e4a6f6d99910d3d32b9151f38c88c86faf2b4bca4ec9b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:18b754f06a9ebe82325e4a6f6d99910d3d32b9151f38c88c86faf2b4bca4ec9b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2209307.
Stopping expansion service pid: 2209308.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 39s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/o6qsnq2hlxsl4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1535
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1535/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417022029",
"environmentId": "RZNhBBnMBPbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-023124"
}
]
},
"name": "go-testxlang_partition-406",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/17 03:15:20 Submitted job: 2023-04-16_20_15_19-13987475360048988696
2023/04/17 03:15:20 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-16_20_15_19-13987475360048988696?project=apache-beam-testing
2023/04/17 03:15:20 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-16_20_15_19-13987475360048988696
2023/04/17 03:15:20 Job state: JOB_STATE_PENDING ...
2023/04/17 03:15:50 Job still running ...
2023/04/17 03:16:20 Job still running ...
2023/04/17 03:16:50 Job still running ...
2023/04/17 03:17:20 Job still running ...
2023/04/17 03:17:50 Job still running ...
2023/04/17 03:18:20 Job still running ...
2023/04/17 03:18:50 Job still running ...
2023/04/17 03:19:20 Job still running ...
2023/04/17 03:19:50 Job still running ...
2023/04/17 03:20:20 Job still running ...
2023/04/17 03:20:50 Job still running ...
2023/04/17 03:21:20 Job still running ...
2023/04/17 03:21:50 Job still running ...
2023/04/17 03:22:20 Job still running ...
2023/04/17 03:22:50 Job still running ...
2023/04/17 03:23:20 Job still running ...
2023/04/17 03:23:50 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-16_20_15_19-13987475360048988696 failed
--- FAIL: TestXLang_Partition (550.04s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3145.116s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681698719115322180
--- FAIL: TestBigQueryIO_BasicWriteRead (4.77s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35469 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@GKQRPFOwtq" is_bounded:BOUNDED windowing_strategy_id:"w0@GKQRPFOwtq"}} windowing_strategies:{key:"w0@GKQRPFOwtq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@GKQRPFOwtq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@GKQRPFOwtq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@GKQRPFOwtq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681698719115322180\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"GKQRPFOwtq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35469 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@GKQRPFOwtq" is_bounded:BOUNDED windowing_strategy_id:"w0@GKQRPFOwtq"}} windowing_strategies:{key:"w0@GKQRPFOwtq" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@GKQRPFOwtq" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@GKQRPFOwtq" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@GKQRPFOwtq" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681698719115322180\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"GKQRPFOwtq"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0006543c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0006543c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00012a080?, 0xc00012e000?}, {0x11c4aa8, 0x39}, {0xc000156000?, 0x10c4960?, 0xc0001220c0?}, {0xc00046de70, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00012a020?, 0xc00012e000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de70, 0xf}, {0xc000050e40, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103380, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.796s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-023124
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-023124
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:648ed8a4ef52d455356cfd86f7bff30db652851d02a53c17fb82fc586b6c368d
Deleted: sha256:66a97c96ac53eb59cc2addaf76a4b581ab6080ef9dcff08b2025d1889f72c91c
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-023124
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:648ed8a4ef52d455356cfd86f7bff30db652851d02a53c17fb82fc586b6c368d
Associated tags:
- 20230417-023124
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-023124
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230417-023124].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:648ed8a4ef52d455356cfd86f7bff30db652851d02a53c17fb82fc586b6c368d].
$ rm -rf /tmp/tmp.3wLcuE7H3p
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417022029
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:098d4156b0b2e9e2902daac4ac5177f4d1df10ecc4834dbb198a7ca7067a6f29
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417022029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:098d4156b0b2e9e2902daac4ac5177f4d1df10ecc4834dbb198a7ca7067a6f29]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230417022029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:098d4156b0b2e9e2902daac4ac5177f4d1df10ecc4834dbb198a7ca7067a6f29])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:098d4156b0b2e9e2902daac4ac5177f4d1df10ecc4834dbb198a7ca7067a6f29
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:098d4156b0b2e9e2902daac4ac5177f4d1df10ecc4834dbb198a7ca7067a6f29
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:098d4156b0b2e9e2902daac4ac5177f4d1df10ecc4834dbb198a7ca7067a6f29].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417022029
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ff64e383f0b30c73960e6fd92ccc6c4e0a30e126b6e730d92ec3b7df0679a069
Deleted: sha256:2e190580ac121b4509141e1a7758d4538efbca74de1829d61e36654c96d18979
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417022029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ff64e383f0b30c73960e6fd92ccc6c4e0a30e126b6e730d92ec3b7df0679a069]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230417022029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ff64e383f0b30c73960e6fd92ccc6c4e0a30e126b6e730d92ec3b7df0679a069])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ff64e383f0b30c73960e6fd92ccc6c4e0a30e126b6e730d92ec3b7df0679a069
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ff64e383f0b30c73960e6fd92ccc6c4e0a30e126b6e730d92ec3b7df0679a069
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ff64e383f0b30c73960e6fd92ccc6c4e0a30e126b6e730d92ec3b7df0679a069].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2130288.
Stopping expansion service pid: 2130289.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 19s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/ak3sh6w3676pa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1534
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1534/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416202039",
"environmentId": "WTdzdDrXDJbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-203143"
}
]
},
"name": "go-testxlang_partition-520",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/16 21:16:14 Submitted job: 2023-04-16_14_16_14-2820313701969891537
2023/04/16 21:16:14 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-16_14_16_14-2820313701969891537?project=apache-beam-testing
2023/04/16 21:16:14 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-16_14_16_14-2820313701969891537
2023/04/16 21:16:14 Job state: JOB_STATE_PENDING ...
2023/04/16 21:16:44 Job still running ...
2023/04/16 21:17:14 Job still running ...
2023/04/16 21:17:44 Job still running ...
2023/04/16 21:18:14 Job still running ...
2023/04/16 21:18:44 Job still running ...
2023/04/16 21:19:14 Job still running ...
2023/04/16 21:19:44 Job still running ...
2023/04/16 21:20:14 Job still running ...
2023/04/16 21:20:44 Job still running ...
2023/04/16 21:21:14 Job still running ...
2023/04/16 21:21:44 Job still running ...
2023/04/16 21:22:15 Job still running ...
2023/04/16 21:22:45 Job still running ...
2023/04/16 21:23:15 Job still running ...
2023/04/16 21:23:45 Job still running ...
2023/04/16 21:24:15 Job still running ...
2023/04/16 21:24:45 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-16_14_16_14-2820313701969891537 failed
--- FAIL: TestXLang_Partition (550.08s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3179.044s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681677139454023233
--- FAIL: TestBigQueryIO_BasicWriteRead (5.31s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36361 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DgmjQNeXvK" is_bounded:BOUNDED windowing_strategy_id:"w0@DgmjQNeXvK"}} windowing_strategies:{key:"w0@DgmjQNeXvK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DgmjQNeXvK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DgmjQNeXvK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DgmjQNeXvK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681677139454023233\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DgmjQNeXvK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36361 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@DgmjQNeXvK" is_bounded:BOUNDED windowing_strategy_id:"w0@DgmjQNeXvK"}} windowing_strategies:{key:"w0@DgmjQNeXvK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@DgmjQNeXvK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@DgmjQNeXvK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@DgmjQNeXvK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681677139454023233\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"DgmjQNeXvK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 22 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc000290640})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc000290640})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e0a0?, 0xc000618000?}, {0x11c4aa8, 0x39}, {0xc00063e000?, 0x10c4960?, 0xc0006100c0?}, {0xc00046de10, 0xf}, 0xc000219d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc000618000?}, {0xc000050e40, 0x52}, {0x1?}, {0xc000219ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc000050e40, 0x52}, {0xf21600, 0xc000146078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d76c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d76c0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.344s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f135889406b89d0c0025cd41ed4837060516226dabea0d296a56088287568c41
Associated tags:
- 20230416-203143
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-203143
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-203143].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f135889406b89d0c0025cd41ed4837060516226dabea0d296a56088287568c41].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2a2df4a605c5a4c728a20eebd8f8cbf431445e711df1acdba822526ba65431b7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2a2df4a605c5a4c728a20eebd8f8cbf431445e711df1acdba822526ba65431b7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2a2df4a605c5a4c728a20eebd8f8cbf431445e711df1acdba822526ba65431b7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2a2df4a605c5a4c728a20eebd8f8cbf431445e711df1acdba822526ba65431b7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b11655b974542410dd144d30413558acd559c8c6896c00a24de5644f7647e940]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b11655b974542410dd144d30413558acd559c8c6896c00a24de5644f7647e940])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b11655b974542410dd144d30413558acd559c8c6896c00a24de5644f7647e940
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b11655b974542410dd144d30413558acd559c8c6896c00a24de5644f7647e940].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 3s
232 actionable tasks: 153 executed, 67 from cache, 12 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/dtqz2ujmqlsbs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1533
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1533/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416142028",
"environmentId": "MlWvqVyLfqbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-143112"
}
]
},
"name": "go-testxlang_partition-594",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/16 15:14:33 Submitted job: 2023-04-16_08_14_33-15127789767579462993
2023/04/16 15:14:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-16_08_14_33-15127789767579462993?project=apache-beam-testing
2023/04/16 15:14:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-16_08_14_33-15127789767579462993
2023/04/16 15:14:33 Job state: JOB_STATE_PENDING ...
2023/04/16 15:15:04 Job still running ...
2023/04/16 15:15:34 Job still running ...
2023/04/16 15:16:04 Job still running ...
2023/04/16 15:16:34 Job still running ...
2023/04/16 15:17:04 Job still running ...
2023/04/16 15:17:34 Job still running ...
2023/04/16 15:18:04 Job still running ...
2023/04/16 15:18:34 Job still running ...
2023/04/16 15:19:04 Job still running ...
2023/04/16 15:19:34 Job still running ...
2023/04/16 15:20:04 Job still running ...
2023/04/16 15:20:34 Job still running ...
2023/04/16 15:21:04 Job still running ...
2023/04/16 15:21:34 Job still running ...
2023/04/16 15:22:04 Job still running ...
2023/04/16 15:22:34 Job still running ...
2023/04/16 15:23:04 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-16_08_14_33-15127789767579462993 failed
--- FAIL: TestXLang_Partition (550.39s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3113.298s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681655504543950525
--- FAIL: TestBigQueryIO_BasicWriteRead (4.58s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44671 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XSwXXgzksR" is_bounded:BOUNDED windowing_strategy_id:"w0@XSwXXgzksR"}} windowing_strategies:{key:"w0@XSwXXgzksR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XSwXXgzksR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XSwXXgzksR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XSwXXgzksR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681655504543950525\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XSwXXgzksR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44671 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@XSwXXgzksR" is_bounded:BOUNDED windowing_strategy_id:"w0@XSwXXgzksR"}} windowing_strategies:{key:"w0@XSwXXgzksR" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@XSwXXgzksR" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@XSwXXgzksR" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@XSwXXgzksR" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681655504543950525\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"XSwXXgzksR"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00065c340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00065c340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000168ac0?, 0xc0001342d0?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc0001ecf60?}, {0xc000045f40, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000168a40?, 0xc0001342d0?}, {0xc00010ec60, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc00010ec60, 0x52}, {0xf21600, 0xc000489340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.617s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-143112
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-143112
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0fb47cc59b513a049d173a788f54203dbc6bbc9bfdc289714d072336acf06bf8
Deleted: sha256:48aa24922584b3254984e670cf99ac6a967a43c481fd5291f0aa3d282f9878b9
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-143112
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0fb47cc59b513a049d173a788f54203dbc6bbc9bfdc289714d072336acf06bf8
Associated tags:
- 20230416-143112
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-143112
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-143112].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0fb47cc59b513a049d173a788f54203dbc6bbc9bfdc289714d072336acf06bf8].
$ rm -rf /tmp/tmp.nwkCDUv6m1
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416142028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:41393a72f9b82cbd51cc7f6f0425bd2049f0ef882a6c25ad86fc62c62715e133
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416142028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:41393a72f9b82cbd51cc7f6f0425bd2049f0ef882a6c25ad86fc62c62715e133]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416142028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:41393a72f9b82cbd51cc7f6f0425bd2049f0ef882a6c25ad86fc62c62715e133])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:41393a72f9b82cbd51cc7f6f0425bd2049f0ef882a6c25ad86fc62c62715e133
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:41393a72f9b82cbd51cc7f6f0425bd2049f0ef882a6c25ad86fc62c62715e133
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:41393a72f9b82cbd51cc7f6f0425bd2049f0ef882a6c25ad86fc62c62715e133].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416142028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1e9daf4b15018e2dd6acb5e82d763b90306c0109f6a2ac4b967988a6277e56c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416142028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1e9daf4b15018e2dd6acb5e82d763b90306c0109f6a2ac4b967988a6277e56c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416142028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1e9daf4b15018e2dd6acb5e82d763b90306c0109f6a2ac4b967988a6277e56c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1e9daf4b15018e2dd6acb5e82d763b90306c0109f6a2ac4b967988a6277e56c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1e9daf4b15018e2dd6acb5e82d763b90306c0109f6a2ac4b967988a6277e56c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1e9daf4b15018e2dd6acb5e82d763b90306c0109f6a2ac4b967988a6277e56c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1949806.
Stopping expansion service pid: 1949807.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 32s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/kkhqfejw2iejm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1532
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1532/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416082028",
"environmentId": "VmRDCmWLMBbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-083100"
}
]
},
"name": "go-testxlang_partition-149",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/16 09:14:55 Submitted job: 2023-04-16_02_14_54-10851749627409262756
2023/04/16 09:14:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-16_02_14_54-10851749627409262756?project=apache-beam-testing
2023/04/16 09:14:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-16_02_14_54-10851749627409262756
2023/04/16 09:14:55 Job state: JOB_STATE_PENDING ...
2023/04/16 09:15:25 Job still running ...
2023/04/16 09:15:55 Job still running ...
2023/04/16 09:16:25 Job still running ...
2023/04/16 09:16:55 Job still running ...
2023/04/16 09:17:25 Job still running ...
2023/04/16 09:17:55 Job still running ...
2023/04/16 09:18:25 Job still running ...
2023/04/16 09:18:55 Job still running ...
2023/04/16 09:19:25 Job still running ...
2023/04/16 09:19:55 Job still running ...
2023/04/16 09:20:25 Job still running ...
2023/04/16 09:20:55 Job still running ...
2023/04/16 09:21:25 Job still running ...
2023/04/16 09:21:55 Job still running ...
2023/04/16 09:22:25 Job still running ...
2023/04/16 09:22:55 Job still running ...
2023/04/16 09:23:26 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-16_02_14_54-10851749627409262756 failed
--- FAIL: TestXLang_Partition (550.95s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3145.170s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681633894151440137
--- FAIL: TestBigQueryIO_BasicWriteRead (4.36s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43489 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AWhEYAShUz" is_bounded:BOUNDED windowing_strategy_id:"w0@AWhEYAShUz"}} windowing_strategies:{key:"w0@AWhEYAShUz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AWhEYAShUz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AWhEYAShUz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AWhEYAShUz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681633894151440137\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AWhEYAShUz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43489 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AWhEYAShUz" is_bounded:BOUNDED windowing_strategy_id:"w0@AWhEYAShUz"}} windowing_strategies:{key:"w0@AWhEYAShUz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AWhEYAShUz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AWhEYAShUz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AWhEYAShUz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681633894151440137\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AWhEYAShUz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 14 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0005b27c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0005b27c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a81c0?, 0xc0000be280?}, {0x11c4aa8, 0x39}, {0xc0005f8000?, 0x10c4960?, 0xc0005c80c0?}, {0xc000137d60, 0xf}, 0xc000569d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a8040?, 0xc0000be280?}, {0xc00004ee40, 0x52}, {0x1?}, {0xc000569ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000137d60, 0xf}, {0xc00004ee40, 0x52}, {0xf21600, 0xc00046c008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001036c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001036c0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.389s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-083100
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-083100
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:347213d12f7afb8516940ca2bf5ac1c92c886d40944be4f80644e671cf4ad05f
Deleted: sha256:8c2894b96b4c31f22e84e4678ac8f6c3bfba1a34378b9c3e25af22d5b574e5e1
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-083100
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:347213d12f7afb8516940ca2bf5ac1c92c886d40944be4f80644e671cf4ad05f
Associated tags:
- 20230416-083100
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-083100
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-083100].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:347213d12f7afb8516940ca2bf5ac1c92c886d40944be4f80644e671cf4ad05f].
$ rm -rf /tmp/tmp.mxdvh2K0B7
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416082028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e15cc57e4c4958f16fcfdd50d3b1e65cdb0f7ed19f7e7c452c80318dfe4ffbe
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e15cc57e4c4958f16fcfdd50d3b1e65cdb0f7ed19f7e7c452c80318dfe4ffbe]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e15cc57e4c4958f16fcfdd50d3b1e65cdb0f7ed19f7e7c452c80318dfe4ffbe])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e15cc57e4c4958f16fcfdd50d3b1e65cdb0f7ed19f7e7c452c80318dfe4ffbe
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e15cc57e4c4958f16fcfdd50d3b1e65cdb0f7ed19f7e7c452c80318dfe4ffbe
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e15cc57e4c4958f16fcfdd50d3b1e65cdb0f7ed19f7e7c452c80318dfe4ffbe].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416082028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de9cbbab427ccb9f7342399a65dcde3ff05bb12c305ee32341e6792e618b1719
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de9cbbab427ccb9f7342399a65dcde3ff05bb12c305ee32341e6792e618b1719]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de9cbbab427ccb9f7342399a65dcde3ff05bb12c305ee32341e6792e618b1719])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de9cbbab427ccb9f7342399a65dcde3ff05bb12c305ee32341e6792e618b1719
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de9cbbab427ccb9f7342399a65dcde3ff05bb12c305ee32341e6792e618b1719
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de9cbbab427ccb9f7342399a65dcde3ff05bb12c305ee32341e6792e618b1719].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1860606.
Stopping expansion service pid: 1860607.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 54s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/2seognpiplcvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1531
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1531/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416022028",
"environmentId": "YinRmjawjEbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-023111"
}
]
},
"name": "go-testxlang_partition-902",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/16 03:15:36 Submitted job: 2023-04-15_20_15_35-17644549735253123527
2023/04/16 03:15:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-15_20_15_35-17644549735253123527?project=apache-beam-testing
2023/04/16 03:15:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-15_20_15_35-17644549735253123527
2023/04/16 03:15:36 Job state: JOB_STATE_PENDING ...
2023/04/16 03:16:06 Job still running ...
2023/04/16 03:16:36 Job still running ...
2023/04/16 03:17:06 Job still running ...
2023/04/16 03:17:36 Job still running ...
2023/04/16 03:18:06 Job still running ...
2023/04/16 03:18:36 Job still running ...
2023/04/16 03:19:06 Job still running ...
2023/04/16 03:19:36 Job still running ...
2023/04/16 03:20:06 Job still running ...
2023/04/16 03:20:36 Job still running ...
2023/04/16 03:21:06 Job still running ...
2023/04/16 03:21:36 Job still running ...
2023/04/16 03:22:07 Job still running ...
2023/04/16 03:22:37 Job still running ...
2023/04/16 03:23:07 Job still running ...
2023/04/16 03:23:37 Job still running ...
2023/04/16 03:24:07 Job still running ...
2023/04/16 03:24:37 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-15_20_15_35-17644549735253123527 failed
--- FAIL: TestXLang_Partition (580.67s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3205.927s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681612304535654987
--- FAIL: TestBigQueryIO_BasicWriteRead (4.81s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37711 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PQXWlwQlxs" is_bounded:BOUNDED windowing_strategy_id:"w0@PQXWlwQlxs"}} windowing_strategies:{key:"w0@PQXWlwQlxs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PQXWlwQlxs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PQXWlwQlxs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PQXWlwQlxs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681612304535654987\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PQXWlwQlxs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37711 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PQXWlwQlxs" is_bounded:BOUNDED windowing_strategy_id:"w0@PQXWlwQlxs"}} windowing_strategies:{key:"w0@PQXWlwQlxs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PQXWlwQlxs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PQXWlwQlxs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PQXWlwQlxs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681612304535654987\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PQXWlwQlxs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 51 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0002d2980})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0002d2980})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00009efc0?, 0xc0000be0f0?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc00019cf60?}, {0xc000045f50, 0xf}, 0xc000219d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00009ef60?, 0xc0000be0f0?}, {0xc000694840, 0x52}, {0x1?}, {0xc000219ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc000694840, 0x52}, {0xf21600, 0xc000489340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005831e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005831e0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.845s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-023111
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-023111
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:83c7c6418131749eafc10a26199b49faae06aac3d4d39c3d9f445bcd25f9cd9f
Deleted: sha256:bbac17141cd8cac0a09f873c1307bc62bfb8c18414bce52b2a823cf9c408b77d
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-023111
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:83c7c6418131749eafc10a26199b49faae06aac3d4d39c3d9f445bcd25f9cd9f
Associated tags:
- 20230416-023111
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-023111
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230416-023111].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:83c7c6418131749eafc10a26199b49faae06aac3d4d39c3d9f445bcd25f9cd9f].
$ rm -rf /tmp/tmp.dgsiBocthe
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416022028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a1b5b4aa693e5f309aaadc84b55ccec27257065b7fcaf76bacd35cf21da3f9c4
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416022028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a1b5b4aa693e5f309aaadc84b55ccec27257065b7fcaf76bacd35cf21da3f9c4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230416022028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a1b5b4aa693e5f309aaadc84b55ccec27257065b7fcaf76bacd35cf21da3f9c4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a1b5b4aa693e5f309aaadc84b55ccec27257065b7fcaf76bacd35cf21da3f9c4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a1b5b4aa693e5f309aaadc84b55ccec27257065b7fcaf76bacd35cf21da3f9c4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a1b5b4aa693e5f309aaadc84b55ccec27257065b7fcaf76bacd35cf21da3f9c4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416022028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25ff1e0820d879bf2683776eebe13bebe9c387d7aeb292a401f235268231a727
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416022028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25ff1e0820d879bf2683776eebe13bebe9c387d7aeb292a401f235268231a727]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230416022028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25ff1e0820d879bf2683776eebe13bebe9c387d7aeb292a401f235268231a727])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25ff1e0820d879bf2683776eebe13bebe9c387d7aeb292a401f235268231a727
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25ff1e0820d879bf2683776eebe13bebe9c387d7aeb292a401f235268231a727
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25ff1e0820d879bf2683776eebe13bebe9c387d7aeb292a401f235268231a727].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1789975.
Stopping expansion service pid: 1789976.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 5s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/3plu46isediye
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1530
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1530/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415202028",
"environmentId": "LOvvAMsFtXbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-203104"
}
]
},
"name": "go-testxlang_partition-27",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/15 21:14:27 Submitted job: 2023-04-15_14_14_27-15840135560544593895
2023/04/15 21:14:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-15_14_14_27-15840135560544593895?project=apache-beam-testing
2023/04/15 21:14:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-15_14_14_27-15840135560544593895
2023/04/15 21:14:27 Job state: JOB_STATE_PENDING ...
2023/04/15 21:14:57 Job still running ...
2023/04/15 21:15:27 Job still running ...
2023/04/15 21:15:57 Job still running ...
2023/04/15 21:16:27 Job still running ...
2023/04/15 21:16:57 Job still running ...
2023/04/15 21:17:28 Job still running ...
2023/04/15 21:17:58 Job still running ...
2023/04/15 21:18:28 Job still running ...
2023/04/15 21:18:58 Job still running ...
2023/04/15 21:19:28 Job still running ...
2023/04/15 21:19:58 Job still running ...
2023/04/15 21:20:28 Job still running ...
2023/04/15 21:20:58 Job still running ...
2023/04/15 21:21:28 Job still running ...
2023/04/15 21:21:58 Job still running ...
2023/04/15 21:22:28 Job still running ...
2023/04/15 21:22:58 Job still running ...
2023/04/15 21:23:28 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-15_14_14_27-15840135560544593895 failed
--- FAIL: TestXLang_Partition (580.18s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3145.110s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681590696709664202
--- FAIL: TestBigQueryIO_BasicWriteRead (4.73s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42271 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@npcHvQfQeU" is_bounded:BOUNDED windowing_strategy_id:"w0@npcHvQfQeU"}} windowing_strategies:{key:"w0@npcHvQfQeU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@npcHvQfQeU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@npcHvQfQeU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@npcHvQfQeU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681590696709664202\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"npcHvQfQeU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42271 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@npcHvQfQeU" is_bounded:BOUNDED windowing_strategy_id:"w0@npcHvQfQeU"}} windowing_strategies:{key:"w0@npcHvQfQeU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@npcHvQfQeU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@npcHvQfQeU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@npcHvQfQeU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681590696709664202\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"npcHvQfQeU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc000292780})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc000292780})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a89e0?, 0xc0005703c0?}, {0x11c4aa8, 0x39}, {0xc0000f20c0?, 0x10c4960?, 0xc00055af00?}, {0xc000121d60, 0xf}, 0xc00057dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a8840?, 0xc0005703c0?}, {0xc00004ede0, 0x52}, {0x1?}, {0xc00057dea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000121d60, 0xf}, {0xc00004ede0, 0x52}, {0xf21600, 0xc0005b10f0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103520, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.758s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-203104
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-203104
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e2effef87653de1f8a1b0025572d34f89e534d623fbd7a121bd18608942e2416
Deleted: sha256:9f065d697c45b6fd862b80b25dce6013193429ab51765ed700a4ffd05c12b59b
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-203104
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e2effef87653de1f8a1b0025572d34f89e534d623fbd7a121bd18608942e2416
Associated tags:
- 20230415-203104
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-203104
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-203104].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e2effef87653de1f8a1b0025572d34f89e534d623fbd7a121bd18608942e2416].
$ rm -rf /tmp/tmp.2FVFbptSdm
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415202028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:91e3b8c9ca81fbb3cee044e1b04902f9088ef6c68c45e498c31e97c9f44632e3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415202028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:91e3b8c9ca81fbb3cee044e1b04902f9088ef6c68c45e498c31e97c9f44632e3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415202028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:91e3b8c9ca81fbb3cee044e1b04902f9088ef6c68c45e498c31e97c9f44632e3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:91e3b8c9ca81fbb3cee044e1b04902f9088ef6c68c45e498c31e97c9f44632e3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:91e3b8c9ca81fbb3cee044e1b04902f9088ef6c68c45e498c31e97c9f44632e3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:91e3b8c9ca81fbb3cee044e1b04902f9088ef6c68c45e498c31e97c9f44632e3].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415202028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc1137653c6c09bb1da7d43b077f1f9c45d3c9ac139a329768c6d300c1e469e9
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415202028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc1137653c6c09bb1da7d43b077f1f9c45d3c9ac139a329768c6d300c1e469e9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415202028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc1137653c6c09bb1da7d43b077f1f9c45d3c9ac139a329768c6d300c1e469e9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc1137653c6c09bb1da7d43b077f1f9c45d3c9ac139a329768c6d300c1e469e9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc1137653c6c09bb1da7d43b077f1f9c45d3c9ac139a329768c6d300c1e469e9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc1137653c6c09bb1da7d43b077f1f9c45d3c9ac139a329768c6d300c1e469e9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1688804.
Stopping expansion service pid: 1688805.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 57s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/w6j5n3isvqv3g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1529
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1529/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-143154",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415142039",
"environmentId": "oXgALAaXgObeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-143154"
}
]
},
"name": "go-testxlang_partition-201",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/15 15:14:20 Submitted job: 2023-04-15_08_14_19-522954996145710106
2023/04/15 15:14:20 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-15_08_14_19-522954996145710106?project=apache-beam-testing
2023/04/15 15:14:20 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-15_08_14_19-522954996145710106
2023/04/15 15:14:20 Job state: JOB_STATE_PENDING ...
2023/04/15 15:14:50 Job still running ...
2023/04/15 15:15:20 Job still running ...
2023/04/15 15:15:50 Job still running ...
2023/04/15 15:16:20 Job still running ...
2023/04/15 15:16:50 Job still running ...
2023/04/15 15:17:20 Job still running ...
2023/04/15 15:17:50 Job still running ...
2023/04/15 15:18:20 Job still running ...
2023/04/15 15:18:50 Job still running ...
2023/04/15 15:19:20 Job still running ...
2023/04/15 15:19:51 Job still running ...
2023/04/15 15:20:21 Job still running ...
2023/04/15 15:20:51 Job still running ...
2023/04/15 15:21:21 Job still running ...
2023/04/15 15:21:51 Job still running ...
2023/04/15 15:22:21 Job still running ...
2023/04/15 15:22:51 Job still running ...
2023/04/15 15:23:21 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-15_08_14_19-522954996145710106 failed
--- FAIL: TestXLang_Partition (581.02s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3087.432s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681569147260955570
--- FAIL: TestBigQueryIO_BasicWriteRead (4.54s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34817 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ulNrNFudWx" is_bounded:BOUNDED windowing_strategy_id:"w0@ulNrNFudWx"}} windowing_strategies:{key:"w0@ulNrNFudWx" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ulNrNFudWx" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ulNrNFudWx" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ulNrNFudWx" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681569147260955570\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ulNrNFudWx"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34817 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ulNrNFudWx" is_bounded:BOUNDED windowing_strategy_id:"w0@ulNrNFudWx"}} windowing_strategies:{key:"w0@ulNrNFudWx" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ulNrNFudWx" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ulNrNFudWx" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ulNrNFudWx" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681569147260955570\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ulNrNFudWx"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0003e6580})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0003e6580})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00050efa0?, 0xc0001342d0?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc00019cf90?}, {0xc000045f30, 0xf}, 0xc000219d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00050ef40?, 0xc0001342d0?}, {0xc00004e900, 0x52}, {0x1?}, {0xc000219ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f30, 0xf}, {0xc00004e900, 0x52}, {0xf21600, 0xc000489340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000582d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000582d00, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.569s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a8c308cf31bec9aa6f2893fef5d30bba19fdf374197299ce57e9fa2b2e229eb4
Associated tags:
- 20230415-143154
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-143154
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-143154].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a8c308cf31bec9aa6f2893fef5d30bba19fdf374197299ce57e9fa2b2e229eb4].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b33679159baa84860ac7bdd453cdc54bb4f8c9db878751c6fbbb7b34c8fbe98c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b33679159baa84860ac7bdd453cdc54bb4f8c9db878751c6fbbb7b34c8fbe98c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b33679159baa84860ac7bdd453cdc54bb4f8c9db878751c6fbbb7b34c8fbe98c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b33679159baa84860ac7bdd453cdc54bb4f8c9db878751c6fbbb7b34c8fbe98c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8897d78d535e42e92ed08bea9ec6332d7029346fda09a6ba5ee9a260f4fc89ec]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8897d78d535e42e92ed08bea9ec6332d7029346fda09a6ba5ee9a260f4fc89ec])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8897d78d535e42e92ed08bea9ec6332d7029346fda09a6ba5ee9a260f4fc89ec
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8897d78d535e42e92ed08bea9ec6332d7029346fda09a6ba5ee9a260f4fc89ec].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 39s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/27qpjmyuvbfag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1528
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1528/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-083138",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415082040",
"environmentId": "pbAmAdFUxSbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-083138"
}
]
},
"name": "go-testxlang_partition-301",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/15 09:16:10 Submitted job: 2023-04-15_02_16_09-11237041567499666025
2023/04/15 09:16:10 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-15_02_16_09-11237041567499666025?project=apache-beam-testing
2023/04/15 09:16:10 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-15_02_16_09-11237041567499666025
2023/04/15 09:16:10 Job state: JOB_STATE_PENDING ...
2023/04/15 09:16:40 Job still running ...
2023/04/15 09:17:10 Job still running ...
2023/04/15 09:17:40 Job still running ...
2023/04/15 09:18:10 Job still running ...
2023/04/15 09:18:40 Job still running ...
2023/04/15 09:19:11 Job still running ...
2023/04/15 09:19:41 Job still running ...
2023/04/15 09:20:11 Job still running ...
2023/04/15 09:20:41 Job still running ...
2023/04/15 09:21:11 Job still running ...
2023/04/15 09:21:42 Job still running ...
2023/04/15 09:22:12 Job still running ...
2023/04/15 09:22:42 Job still running ...
2023/04/15 09:23:12 Job still running ...
2023/04/15 09:23:42 Job still running ...
2023/04/15 09:24:12 Job still running ...
2023/04/15 09:24:42 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-15_02_16_09-11237041567499666025 failed
--- FAIL: TestXLang_Partition (552.27s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3178.480s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681547538696324454
--- FAIL: TestBigQueryIO_BasicWriteRead (6.23s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42513 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vhvtFNklyT" is_bounded:BOUNDED windowing_strategy_id:"w0@vhvtFNklyT"}} windowing_strategies:{key:"w0@vhvtFNklyT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vhvtFNklyT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vhvtFNklyT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vhvtFNklyT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681547538696324454\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vhvtFNklyT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42513 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vhvtFNklyT" is_bounded:BOUNDED windowing_strategy_id:"w0@vhvtFNklyT"}} windowing_strategies:{key:"w0@vhvtFNklyT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vhvtFNklyT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vhvtFNklyT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vhvtFNklyT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681547538696324454\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vhvtFNklyT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 67 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0000b2240})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0000b2240})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000d4080?, 0xc000134230?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc0000ce0c0?}, {0xc000045f50, 0xf}, 0xc000325d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000d4020?, 0xc000134230?}, {0xc00004e900, 0x52}, {0x1?}, {0xc000325ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc00004e900, 0x52}, {0xf21600, 0xc00012c078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503860, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.253s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.043s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a8d9ae00d7bec21d6c6f435433b88aa01d2f7e84168852b251d0f99e6ec24189
Associated tags:
- 20230415-083138
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-083138
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-083138].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a8d9ae00d7bec21d6c6f435433b88aa01d2f7e84168852b251d0f99e6ec24189].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:01d74239ff4213d1b1f5f0afd2fe9f99ca9c82ef2c5dbfec8d1b27da5380b081]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:01d74239ff4213d1b1f5f0afd2fe9f99ca9c82ef2c5dbfec8d1b27da5380b081])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:01d74239ff4213d1b1f5f0afd2fe9f99ca9c82ef2c5dbfec8d1b27da5380b081
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:01d74239ff4213d1b1f5f0afd2fe9f99ca9c82ef2c5dbfec8d1b27da5380b081].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fb3baed0ccff42653c3142cbd4f009bb80b3570e7973d85346dde24500119ab8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fb3baed0ccff42653c3142cbd4f009bb80b3570e7973d85346dde24500119ab8])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fb3baed0ccff42653c3142cbd4f009bb80b3570e7973d85346dde24500119ab8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fb3baed0ccff42653c3142cbd4f009bb80b3570e7973d85346dde24500119ab8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 59s
232 actionable tasks: 162 executed, 58 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/4n35d2mty7t4k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1527
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1527/display/redirect>
Changes:
------------------------------------------
[...truncated 671.31 KB...]
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-053332",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-053332"
}
]
},
"name": "go-testxlang_prefix-762",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/15 05:34:19 Submitted job: 2023-04-14_22_34_19-12766221155464951457
2023/04/15 05:34:19 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-14_22_34_19-12766221155464951457?project=apache-beam-testing
2023/04/15 05:34:19 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-14_22_34_19-12766221155464951457
2023/04/15 05:34:19 Job state: JOB_STATE_PENDING ...
2023/04/15 05:34:49 Job still running ...
2023/04/15 05:35:19 Job still running ...
2023/04/15 05:35:49 Job still running ...
2023/04/15 05:36:19 Job still running ...
2023/04/15 05:36:49 Job still running ...
2023/04/15 05:37:19 Job still running ...
2023/04/15 05:37:49 Job still running ...
2023/04/15 05:38:19 Job still running ...
2023/04/15 05:38:49 Job still running ...
2023/04/15 05:39:20 Job still running ...
2023/04/15 05:39:50 Job still running ...
2023/04/15 05:40:20 Job still running ...
2023/04/15 05:40:50 Job still running ...
2023/04/15 05:41:20 Job still running ...
2023/04/15 05:41:50 Job still running ...
2023/04/15 05:42:20 Job still running ...
2023/04/15 05:42:50 Job still running ...
2023/04/15 05:43:20 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-14_22_34_19-12766221155464951457 failed
--- FAIL: TestXLang_Prefix (582.51s)
=== RUN TestXLang_CoGroupBy
--- FAIL: TestXLang_CoGroupBy (15.00s)
panic: tried cross-language for beam:transforms:xlang:test:cgbk against localhost:34727 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n3" value:{unique_name:"n3" coder_id:"c2@TEuoZQmnub" is_bounded:BOUNDED windowing_strategy_id:"w0@TEuoZQmnub"}} pcollections:{key:"n6" value:{unique_name:"n6" coder_id:"c2@TEuoZQmnub" is_bounded:BOUNDED windowing_strategy_id:"w0@TEuoZQmnub"}} windowing_strategies:{key:"w0@TEuoZQmnub" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c3@TEuoZQmnub" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TEuoZQmnub" value:{spec:{urn:"beam:coder:varint:v1"}}} coders:{key:"c1@TEuoZQmnub" value:{spec:{urn:"beam:coder:string_utf8:v1"}}} coders:{key:"c2@TEuoZQmnub" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@TEuoZQmnub" component_coder_ids:"c1@TEuoZQmnub"}} coders:{key:"c3@TEuoZQmnub" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transforms:xlang:test:cgbk"} inputs:{key:"col1" value:"n3"} inputs:{key:"col2" value:"n6"} environment_id:"go"} namespace:"TEuoZQmnub"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:34727: connect: connection refused" [recovered]
panic: tried cross-language for beam:transforms:xlang:test:cgbk against localhost:34727 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n3" value:{unique_name:"n3" coder_id:"c2@TEuoZQmnub" is_bounded:BOUNDED windowing_strategy_id:"w0@TEuoZQmnub"}} pcollections:{key:"n6" value:{unique_name:"n6" coder_id:"c2@TEuoZQmnub" is_bounded:BOUNDED windowing_strategy_id:"w0@TEuoZQmnub"}} windowing_strategies:{key:"w0@TEuoZQmnub" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c3@TEuoZQmnub" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@TEuoZQmnub" value:{spec:{urn:"beam:coder:varint:v1"}}} coders:{key:"c1@TEuoZQmnub" value:{spec:{urn:"beam:coder:string_utf8:v1"}}} coders:{key:"c2@TEuoZQmnub" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@TEuoZQmnub" component_coder_ids:"c1@TEuoZQmnub"}} coders:{key:"c3@TEuoZQmnub" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transforms:xlang:test:cgbk"} inputs:{key:"col1" value:"n3"} inputs:{key:"col2" value:"n6"} environment_id:"go"} namespace:"TEuoZQmnub"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:34727: connect: connection refused"
goroutine 273 [running]:
testing.tRunner.func1.2({0xe558e0, 0xc00063a340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xe558e0, 0xc00063a340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001aca60?, 0xc000526690?}, {0xfa4ac7, 0x1f}, {0x0?, 0xa9ea0e?, 0x0?}, {0x7fffc40e6461, 0xf}, 0xc0006d9c30, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/examples/xlang.CoGroupByKey({0xc0001ac740?, 0xc000526690?}, {0x7fffc40e6461, 0xf}, {0xc0007067a0?}, {0x0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/examples/xlang/transforms.go>:60 +0x434
github.com/apache/beam/sdks/v2/go/test/integration/xlang.TestXLang_CoGroupBy(0xc0004c96c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/xlang/xlang_test.go>:144 +0x41a
testing.tRunner(0xc0004c96c0, 0xff21f0)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 600.918s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681536852834785209
--- FAIL: TestBigQueryIO_BasicWriteRead (5.59s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43539 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FSkHEJrPOT" is_bounded:BOUNDED windowing_strategy_id:"w0@FSkHEJrPOT"}} windowing_strategies:{key:"w0@FSkHEJrPOT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FSkHEJrPOT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FSkHEJrPOT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FSkHEJrPOT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681536852834785209\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FSkHEJrPOT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43539 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FSkHEJrPOT" is_bounded:BOUNDED windowing_strategy_id:"w0@FSkHEJrPOT"}} windowing_strategies:{key:"w0@FSkHEJrPOT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FSkHEJrPOT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FSkHEJrPOT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FSkHEJrPOT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681536852834785209\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FSkHEJrPOT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 66 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00056e800})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00056e800})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00064c0c0?, 0xc00012e000?}, {0x11c4aa8, 0x39}, {0xc000158000?, 0x10c4960?, 0xc0001260c0?}, {0xc00046de70, 0xf}, 0xc000567d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00064c060?, 0xc00012e000?}, {0xc00004ee40, 0x52}, {0x1?}, {0xc000567ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de70, 0xf}, {0xc00004ee40, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103520, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.617s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.050s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f2c7b29e086e46ad531a06ed21ffbf265d195b6f0959bd3ae47866c4541b9a81
Associated tags:
- 20230415-053332
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-053332
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230415-053332].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f2c7b29e086e46ad531a06ed21ffbf265d195b6f0959bd3ae47866c4541b9a81].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415052155]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:12dffb559ed95ed76ad775186fe94754c05aed10a4242991c061eb0bdde92125]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230415052155] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:12dffb559ed95ed76ad775186fe94754c05aed10a4242991c061eb0bdde92125])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:12dffb559ed95ed76ad775186fe94754c05aed10a4242991c061eb0bdde92125
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:12dffb559ed95ed76ad775186fe94754c05aed10a4242991c061eb0bdde92125].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415052155]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bf980078ae9dae78ffcc9c2679473e14c271e7c8bd3d274370322b0bb81deecb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230415052155] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bf980078ae9dae78ffcc9c2679473e14c271e7c8bd3d274370322b0bb81deecb])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bf980078ae9dae78ffcc9c2679473e14c271e7c8bd3d274370322b0bb81deecb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bf980078ae9dae78ffcc9c2679473e14c271e7c8bd3d274370322b0bb81deecb].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 22m 52s
232 actionable tasks: 171 executed, 51 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/2rbau4nhec3jg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1526
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1526/display/redirect?page=changes>
Changes:
[noreply] Download codecov uploader since codecov has been removed from pypi
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414202045",
"environmentId": "NuIDqtCAAabeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-203215",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-203215"
}
]
},
"name": "go-testxlang_partition-617",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/14 21:18:19 Submitted job: 2023-04-14_14_18_19-8529424633338003704
2023/04/14 21:18:19 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-14_14_18_19-8529424633338003704?project=apache-beam-testing
2023/04/14 21:18:19 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-14_14_18_19-8529424633338003704
2023/04/14 21:18:19 Job state: JOB_STATE_PENDING ...
2023/04/14 21:18:49 Job still running ...
2023/04/14 21:19:19 Job still running ...
2023/04/14 21:19:49 Job still running ...
2023/04/14 21:20:19 Job still running ...
2023/04/14 21:20:49 Job still running ...
2023/04/14 21:21:19 Job still running ...
2023/04/14 21:21:49 Job still running ...
2023/04/14 21:22:19 Job still running ...
2023/04/14 21:22:49 Job still running ...
2023/04/14 21:23:19 Job still running ...
2023/04/14 21:23:49 Job still running ...
2023/04/14 21:24:20 Job still running ...
2023/04/14 21:24:50 Job still running ...
2023/04/14 21:25:20 Job still running ...
2023/04/14 21:25:50 Job still running ...
2023/04/14 21:26:20 Job still running ...
2023/04/14 21:26:50 Job still running ...
2023/04/14 21:27:20 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-14_14_18_19-8529424633338003704 failed
--- FAIL: TestXLang_Partition (581.74s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3301.506s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681504376761770835
--- FAIL: TestBigQueryIO_BasicWriteRead (5.83s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40023 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IRJCZthteF" is_bounded:BOUNDED windowing_strategy_id:"w0@IRJCZthteF"}} windowing_strategies:{key:"w0@IRJCZthteF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IRJCZthteF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IRJCZthteF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IRJCZthteF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681504376761770835\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IRJCZthteF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40023 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@IRJCZthteF" is_bounded:BOUNDED windowing_strategy_id:"w0@IRJCZthteF"}} windowing_strategies:{key:"w0@IRJCZthteF" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@IRJCZthteF" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@IRJCZthteF" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@IRJCZthteF" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681504376761770835\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"IRJCZthteF"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0002903c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0002903c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000546080?, 0xc000134230?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc0005400c0?}, {0xc000487f80, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000546020?, 0xc000134230?}, {0xc00004e900, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000487f80, 0xf}, {0xc00004e900, 0x52}, {0xf21600, 0xc00012c078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000c01a0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000c01a0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.859s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.038s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.041s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:44891dd04c2476f7acdfa248dfa2d921c6d4f8d5164baa84940390a14e86fa88
Associated tags:
- 20230414-203215
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-203215
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-203215].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:44891dd04c2476f7acdfa248dfa2d921c6d4f8d5164baa84940390a14e86fa88].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414202045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62de97a1f86e193cab526fea622642d50731ead399bc338ee7cc4408ad4734ec]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414202045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62de97a1f86e193cab526fea622642d50731ead399bc338ee7cc4408ad4734ec])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62de97a1f86e193cab526fea622642d50731ead399bc338ee7cc4408ad4734ec
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62de97a1f86e193cab526fea622642d50731ead399bc338ee7cc4408ad4734ec].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414202045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7bf29c47163d39cb83b60702d8d752938073951ce7e69695bf1e420a3e56b0a9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414202045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7bf29c47163d39cb83b60702d8d752938073951ce7e69695bf1e420a3e56b0a9])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7bf29c47163d39cb83b60702d8d752938073951ce7e69695bf1e420a3e56b0a9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7bf29c47163d39cb83b60702d8d752938073951ce7e69695bf1e420a3e56b0a9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 33s
232 actionable tasks: 191 executed, 31 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/jhot5l6vz36yq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1525
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1525/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414142040",
"environmentId": "dXmLcDoGPwbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-143216"
}
]
},
"name": "go-testxlang_partition-740",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/14 15:16:53 Submitted job: 2023-04-14_08_16_52-6103309020095391277
2023/04/14 15:16:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-14_08_16_52-6103309020095391277?project=apache-beam-testing
2023/04/14 15:16:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-14_08_16_52-6103309020095391277
2023/04/14 15:16:53 Job state: JOB_STATE_PENDING ...
2023/04/14 15:17:23 Job still running ...
2023/04/14 15:17:53 Job still running ...
2023/04/14 15:18:23 Job still running ...
2023/04/14 15:18:53 Job still running ...
2023/04/14 15:19:23 Job still running ...
2023/04/14 15:19:53 Job still running ...
2023/04/14 15:20:23 Job still running ...
2023/04/14 15:20:53 Job still running ...
2023/04/14 15:21:23 Job still running ...
2023/04/14 15:21:53 Job still running ...
2023/04/14 15:22:23 Job still running ...
2023/04/14 15:22:53 Job still running ...
2023/04/14 15:23:23 Job still running ...
2023/04/14 15:23:53 Job still running ...
2023/04/14 15:24:23 Job still running ...
2023/04/14 15:24:53 Job still running ...
2023/04/14 15:25:23 Job still running ...
2023/04/14 15:25:53 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-14_08_16_52-6103309020095391277 failed
--- FAIL: TestXLang_Partition (580.69s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3212.882s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681482774865063185
--- FAIL: TestBigQueryIO_BasicWriteRead (5.54s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34597 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NoZWsqCpto" is_bounded:BOUNDED windowing_strategy_id:"w0@NoZWsqCpto"}} windowing_strategies:{key:"w0@NoZWsqCpto" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NoZWsqCpto" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NoZWsqCpto" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NoZWsqCpto" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681482774865063185\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NoZWsqCpto"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34597 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NoZWsqCpto" is_bounded:BOUNDED windowing_strategy_id:"w0@NoZWsqCpto"}} windowing_strategies:{key:"w0@NoZWsqCpto" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NoZWsqCpto" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NoZWsqCpto" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NoZWsqCpto" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681482774865063185\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NoZWsqCpto"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0005d0400})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0005d0400})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a81c0?, 0xc00079c230?}, {0x11c4aa8, 0x39}, {0xc0000f20c0?, 0x10c4960?, 0xc0006900c0?}, {0xc00046d980, 0xf}, 0xc000553d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a8040?, 0xc00079c230?}, {0xc00004eb40, 0x52}, {0x1?}, {0xc000553ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046d980, 0xf}, {0xc00004eb40, 0x52}, {0xf21600, 0xc000650048})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000682b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000682b60, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.563s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.035s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-143216
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-143216
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5638baac8dc0486b5a3758463622c2964bd99f8feb37d320e19ae2d6a4658487
Deleted: sha256:58b577195bcd933491e14aa54ffeca3940a526a1a5f4f692335df0b631e6e9b7
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-143216
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5638baac8dc0486b5a3758463622c2964bd99f8feb37d320e19ae2d6a4658487
Associated tags:
- 20230414-143216
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-143216
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-143216].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5638baac8dc0486b5a3758463622c2964bd99f8feb37d320e19ae2d6a4658487].
$ rm -rf /tmp/tmp.SGVO5wJWmD
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c3d80459468fde77c2bf814559b3f6d6f61efd84ab67ff91b40cc7b47b86d03b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c3d80459468fde77c2bf814559b3f6d6f61efd84ab67ff91b40cc7b47b86d03b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c3d80459468fde77c2bf814559b3f6d6f61efd84ab67ff91b40cc7b47b86d03b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c3d80459468fde77c2bf814559b3f6d6f61efd84ab67ff91b40cc7b47b86d03b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c3d80459468fde77c2bf814559b3f6d6f61efd84ab67ff91b40cc7b47b86d03b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c3d80459468fde77c2bf814559b3f6d6f61efd84ab67ff91b40cc7b47b86d03b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74f08e9d22198494299115c2772133a6684f76a9de313f333934f0d78476c689
Deleted: sha256:fd8be3409743effa711a8892dd9db6f5fdafe1346ec5ce32621f8c10a0928567
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74f08e9d22198494299115c2772133a6684f76a9de313f333934f0d78476c689]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74f08e9d22198494299115c2772133a6684f76a9de313f333934f0d78476c689])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74f08e9d22198494299115c2772133a6684f76a9de313f333934f0d78476c689
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74f08e9d22198494299115c2772133a6684f76a9de313f333934f0d78476c689
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74f08e9d22198494299115c2772133a6684f76a9de313f333934f0d78476c689].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2688139.
Stopping expansion service pid: 2688140.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 8s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/hdjddxmvalegc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1524
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1524/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-083136",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414082033",
"environmentId": "fWlzUbbphJbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-083136"
}
]
},
"name": "go-testxlang_partition-6",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/14 09:15:33 Submitted job: 2023-04-14_02_15_32-18392060555364468654
2023/04/14 09:15:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-14_02_15_32-18392060555364468654?project=apache-beam-testing
2023/04/14 09:15:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-14_02_15_32-18392060555364468654
2023/04/14 09:15:33 Job state: JOB_STATE_PENDING ...
2023/04/14 09:16:03 Job still running ...
2023/04/14 09:16:33 Job still running ...
2023/04/14 09:17:03 Job still running ...
2023/04/14 09:17:33 Job still running ...
2023/04/14 09:18:03 Job still running ...
2023/04/14 09:18:33 Job still running ...
2023/04/14 09:19:03 Job still running ...
2023/04/14 09:19:33 Job still running ...
2023/04/14 09:20:03 Job still running ...
2023/04/14 09:20:33 Job still running ...
2023/04/14 09:21:03 Job still running ...
2023/04/14 09:21:33 Job still running ...
2023/04/14 09:22:04 Job still running ...
2023/04/14 09:22:34 Job still running ...
ptest.go:108: Failed to execute job: failed to get job
caused by:
googleapi: Error 503: The service is currently unavailable., backendError
--- FAIL: TestXLang_Partition (490.37s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3088.798s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681461128634072319
--- FAIL: TestBigQueryIO_BasicWriteRead (4.34s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35921 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uXcISCZHiS" is_bounded:BOUNDED windowing_strategy_id:"w0@uXcISCZHiS"}} windowing_strategies:{key:"w0@uXcISCZHiS" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uXcISCZHiS" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uXcISCZHiS" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uXcISCZHiS" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681461128634072319\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uXcISCZHiS"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35921 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uXcISCZHiS" is_bounded:BOUNDED windowing_strategy_id:"w0@uXcISCZHiS"}} windowing_strategies:{key:"w0@uXcISCZHiS" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uXcISCZHiS" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uXcISCZHiS" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uXcISCZHiS" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681461128634072319\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uXcISCZHiS"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 40 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc000537000})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc000537000})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000d6080?, 0xc000134230?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc0000d00c0?}, {0xc000489f80, 0xf}, 0xc0002a9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000d6020?, 0xc000134230?}, {0xc000532840, 0x52}, {0x1?}, {0xc0002a9ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc000532840, 0x52}, {0xf21600, 0xc00012c078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000581520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000581520, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.370s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:be9079e3ad70fe8528e2ba91eb303a7b5966b2dba3f08ad51cf7ae722f576ad1
Associated tags:
- 20230414-083136
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-083136
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-083136].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:be9079e3ad70fe8528e2ba91eb303a7b5966b2dba3f08ad51cf7ae722f576ad1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414082033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5961d525120a72e291ef265bb8cb60059a263f06150644add0f0981129f0a47e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414082033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5961d525120a72e291ef265bb8cb60059a263f06150644add0f0981129f0a47e])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5961d525120a72e291ef265bb8cb60059a263f06150644add0f0981129f0a47e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5961d525120a72e291ef265bb8cb60059a263f06150644add0f0981129f0a47e].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414082033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0894b3b8a03ae18dc838536bc806ffec8bda370b29593c76dc0eb429cb6c6fce]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414082033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0894b3b8a03ae18dc838536bc806ffec8bda370b29593c76dc0eb429cb6c6fce])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0894b3b8a03ae18dc838536bc806ffec8bda370b29593c76dc0eb429cb6c6fce
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0894b3b8a03ae18dc838536bc806ffec8bda370b29593c76dc0eb429cb6c6fce].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 28s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/rbo2yretaq6hm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1523
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1523/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"environmentId": "YsCAibuDUcbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-023215",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-023215"
}
]
},
"name": "go-testxlang_partition-557",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/14 03:15:55 Submitted job: 2023-04-13_20_15_54-4686318348179220451
2023/04/14 03:15:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-13_20_15_54-4686318348179220451?project=apache-beam-testing
2023/04/14 03:15:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-13_20_15_54-4686318348179220451
2023/04/14 03:15:55 Job state: JOB_STATE_PENDING ...
2023/04/14 03:16:25 Job still running ...
2023/04/14 03:16:55 Job still running ...
2023/04/14 03:17:25 Job still running ...
2023/04/14 03:17:55 Job still running ...
2023/04/14 03:18:25 Job still running ...
2023/04/14 03:18:55 Job still running ...
2023/04/14 03:19:25 Job still running ...
2023/04/14 03:19:55 Job still running ...
2023/04/14 03:20:25 Job still running ...
2023/04/14 03:20:55 Job still running ...
2023/04/14 03:21:25 Job still running ...
2023/04/14 03:21:55 Job still running ...
2023/04/14 03:22:25 Job still running ...
2023/04/14 03:22:55 Job still running ...
2023/04/14 03:23:25 Job still running ...
2023/04/14 03:23:56 Job still running ...
2023/04/14 03:24:26 Job still running ...
2023/04/14 03:24:56 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-13_20_15_54-4686318348179220451 failed
--- FAIL: TestXLang_Partition (580.40s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3154.248s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681439576043732207
--- FAIL: TestBigQueryIO_BasicWriteRead (6.68s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37529 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WUGRdbdkGJ" is_bounded:BOUNDED windowing_strategy_id:"w0@WUGRdbdkGJ"}} windowing_strategies:{key:"w0@WUGRdbdkGJ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WUGRdbdkGJ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WUGRdbdkGJ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WUGRdbdkGJ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681439576043732207\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WUGRdbdkGJ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37529 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WUGRdbdkGJ" is_bounded:BOUNDED windowing_strategy_id:"w0@WUGRdbdkGJ"}} windowing_strategies:{key:"w0@WUGRdbdkGJ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WUGRdbdkGJ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WUGRdbdkGJ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WUGRdbdkGJ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681439576043732207\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WUGRdbdkGJ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 16 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0002ceac0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0002ceac0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005de0c0?, 0xc0005f6000?}, {0x11c4aa8, 0x39}, {0xc000208000?, 0x10c4960?, 0xc0005ee0c0?}, {0xc00046de10, 0xf}, 0xc000567d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005de060?, 0xc0005f6000?}, {0xc00004ee40, 0x52}, {0x1?}, {0xc000567ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de10, 0xf}, {0xc00004ee40, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000642d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000642d00, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.718s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.038s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.049s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-023215
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-023215
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0396f8d09d7501aa35a6fcc3d40f20cabe0f2d35ba9a8502f12861dd03464c4a
Deleted: sha256:bcfcea49b421a977e5a8e3e03ae8f58d015aa54eb94b6e0622e76b46330cc38f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-023215
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0396f8d09d7501aa35a6fcc3d40f20cabe0f2d35ba9a8502f12861dd03464c4a
Associated tags:
- 20230414-023215
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-023215
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230414-023215].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0396f8d09d7501aa35a6fcc3d40f20cabe0f2d35ba9a8502f12861dd03464c4a].
$ rm -rf /tmp/tmp.yupTSXQ9Ct
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:793f7a6168766e963c12ed87544729a93abdb818f161a434d4e85d46b20a147b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:793f7a6168766e963c12ed87544729a93abdb818f161a434d4e85d46b20a147b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230414022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:793f7a6168766e963c12ed87544729a93abdb818f161a434d4e85d46b20a147b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:793f7a6168766e963c12ed87544729a93abdb818f161a434d4e85d46b20a147b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:793f7a6168766e963c12ed87544729a93abdb818f161a434d4e85d46b20a147b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:793f7a6168766e963c12ed87544729a93abdb818f161a434d4e85d46b20a147b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6300bba2b9d4bf96498dffbc738da6ad51139294c2107bbf539f0bbd27db553d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6300bba2b9d4bf96498dffbc738da6ad51139294c2107bbf539f0bbd27db553d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230414022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6300bba2b9d4bf96498dffbc738da6ad51139294c2107bbf539f0bbd27db553d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6300bba2b9d4bf96498dffbc738da6ad51139294c2107bbf539f0bbd27db553d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6300bba2b9d4bf96498dffbc738da6ad51139294c2107bbf539f0bbd27db553d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6300bba2b9d4bf96498dffbc738da6ad51139294c2107bbf539f0bbd27db553d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1891992.
Stopping expansion service pid: 1891993.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 13s
232 actionable tasks: 185 executed, 37 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/xpwnaxxhzefso
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1522
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1522/display/redirect>
Changes:
------------------------------------------
[...truncated 1019.46 KB...]
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413202039",
"environmentId": "JeUCQHYCpjbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-203112"
}
]
},
"name": "go-testxlang_partition-339",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/13 21:17:15 Submitted job: 2023-04-13_14_17_14-1343791983826538778
2023/04/13 21:17:15 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-13_14_17_14-1343791983826538778?project=apache-beam-testing
2023/04/13 21:17:15 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-13_14_17_14-1343791983826538778
2023/04/13 21:17:15 Job state: JOB_STATE_PENDING ...
2023/04/13 21:17:45 Job still running ...
2023/04/13 21:18:15 Job still running ...
2023/04/13 21:18:45 Job still running ...
2023/04/13 21:19:15 Job still running ...
2023/04/13 21:19:45 Job still running ...
2023/04/13 21:20:15 Job still running ...
2023/04/13 21:20:45 Job still running ...
2023/04/13 21:21:15 Job still running ...
2023/04/13 21:21:45 Job still running ...
2023/04/13 21:22:15 Job still running ...
2023/04/13 21:22:45 Job still running ...
2023/04/13 21:23:15 Job still running ...
2023/04/13 21:23:45 Job still running ...
2023/04/13 21:24:15 Job still running ...
2023/04/13 21:24:45 Job still running ...
2023/04/13 21:25:15 Job still running ...
2023/04/13 21:25:45 Job still running ...
2023/04/13 21:26:15 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-13_14_17_14-1343791983826538778 failed
--- FAIL: TestXLang_Partition (588.51s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3274.374s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681417940148043086
--- FAIL: TestBigQueryIO_BasicWriteRead (12.84s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37909 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FDgvFrmoeI" is_bounded:BOUNDED windowing_strategy_id:"w0@FDgvFrmoeI"}} windowing_strategies:{key:"w0@FDgvFrmoeI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FDgvFrmoeI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FDgvFrmoeI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FDgvFrmoeI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681417940148043086\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FDgvFrmoeI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37909 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FDgvFrmoeI" is_bounded:BOUNDED windowing_strategy_id:"w0@FDgvFrmoeI"}} windowing_strategies:{key:"w0@FDgvFrmoeI" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FDgvFrmoeI" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FDgvFrmoeI" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FDgvFrmoeI" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681417940148043086\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FDgvFrmoeI"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 27 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0000e2a00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0000e2a00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000512080?, 0xc000514000?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc00050c0c0?}, {0xc000045f40, 0xf}, 0xc000153d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000512020?, 0xc000514000?}, {0xc00004e900, 0x52}, {0x1?}, {0xc000153ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f40, 0xf}, {0xc00004e900, 0x52}, {0xf21600, 0xc00012c078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005031e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005031e0, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 15.866s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.041s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-203112
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-203112
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a89c539b02ec40cd5e06b8389520876c9493064dacdd59af85bb5ac936614531
Deleted: sha256:4c9ab9d0c496e8f810dc77797e6d0235b776212a7c99620424bb3f8fcecd964e
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-203112
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a89c539b02ec40cd5e06b8389520876c9493064dacdd59af85bb5ac936614531
Associated tags:
- 20230413-203112
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-203112
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-203112].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a89c539b02ec40cd5e06b8389520876c9493064dacdd59af85bb5ac936614531].
$ rm -rf /tmp/tmp.nx9lINKhhB
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413202039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e41b3fcab2ae8edeba71eeec28dc5dd9a1a3e407120ec5d463bf080e4a6b5d6
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e41b3fcab2ae8edeba71eeec28dc5dd9a1a3e407120ec5d463bf080e4a6b5d6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e41b3fcab2ae8edeba71eeec28dc5dd9a1a3e407120ec5d463bf080e4a6b5d6])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e41b3fcab2ae8edeba71eeec28dc5dd9a1a3e407120ec5d463bf080e4a6b5d6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e41b3fcab2ae8edeba71eeec28dc5dd9a1a3e407120ec5d463bf080e4a6b5d6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7e41b3fcab2ae8edeba71eeec28dc5dd9a1a3e407120ec5d463bf080e4a6b5d6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413202039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f46d3c4a0d9f1ab9d0c8c652250e12a044054b4b9f6c6aaf8be6c6b2d86db53a
Deleted: sha256:d6e5893b8c6b5934114265ca3b422bb5a71081cbb5ec92b38e6d17f1a8965f3c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f46d3c4a0d9f1ab9d0c8c652250e12a044054b4b9f6c6aaf8be6c6b2d86db53a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f46d3c4a0d9f1ab9d0c8c652250e12a044054b4b9f6c6aaf8be6c6b2d86db53a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f46d3c4a0d9f1ab9d0c8c652250e12a044054b4b9f6c6aaf8be6c6b2d86db53a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f46d3c4a0d9f1ab9d0c8c652250e12a044054b4b9f6c6aaf8be6c6b2d86db53a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f46d3c4a0d9f1ab9d0c8c652250e12a044054b4b9f6c6aaf8be6c6b2d86db53a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2202652.
Stopping expansion service pid: 2202653.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 48s
232 actionable tasks: 163 executed, 57 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/sotfulr3q5ry4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1521
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1521/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413142105",
"environmentId": "KfcpQQxtujbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-143540"
}
]
},
"name": "go-testxlang_partition-232",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/13 15:19:45 Submitted job: 2023-04-13_08_19_44-12426289987318597462
2023/04/13 15:19:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-13_08_19_44-12426289987318597462?project=apache-beam-testing
2023/04/13 15:19:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-13_08_19_44-12426289987318597462
2023/04/13 15:19:45 Job state: JOB_STATE_PENDING ...
2023/04/13 15:20:15 Job still running ...
2023/04/13 15:20:45 Job still running ...
2023/04/13 15:21:15 Job still running ...
2023/04/13 15:21:45 Job still running ...
2023/04/13 15:22:15 Job still running ...
2023/04/13 15:22:45 Job still running ...
2023/04/13 15:23:15 Job still running ...
2023/04/13 15:23:45 Job still running ...
2023/04/13 15:24:15 Job still running ...
2023/04/13 15:24:45 Job still running ...
2023/04/13 15:25:15 Job still running ...
2023/04/13 15:25:45 Job still running ...
2023/04/13 15:26:15 Job still running ...
2023/04/13 15:26:45 Job still running ...
2023/04/13 15:27:15 Job still running ...
2023/04/13 15:27:45 Job still running ...
2023/04/13 15:28:15 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-13_08_19_44-12426289987318597462 failed
--- FAIL: TestXLang_Partition (554.42s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3152.048s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681396582710971263
--- FAIL: TestBigQueryIO_BasicWriteRead (5.92s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40223 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@OpMXYLomeA" is_bounded:BOUNDED windowing_strategy_id:"w0@OpMXYLomeA"}} windowing_strategies:{key:"w0@OpMXYLomeA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@OpMXYLomeA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@OpMXYLomeA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@OpMXYLomeA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681396582710971263\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"OpMXYLomeA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40223 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@OpMXYLomeA" is_bounded:BOUNDED windowing_strategy_id:"w0@OpMXYLomeA"}} windowing_strategies:{key:"w0@OpMXYLomeA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@OpMXYLomeA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@OpMXYLomeA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@OpMXYLomeA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681396582710971263\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"OpMXYLomeA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00051e500})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00051e500})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00071cf80?, 0xc0000bc460?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc000286f60?}, {0xc000489f80, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00071cf20?, 0xc0000bc460?}, {0xc00010eba0, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f80, 0xf}, {0xc00010eba0, 0x52}, {0xf21600, 0xc000045340})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031d860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031d860, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.951s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.038s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-143540
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-143540
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cbea29996db443ce7a81623a6c3cd51b572817fc31709ec8607ecb4c99d401e5
Deleted: sha256:15a426f893a7a4826bc0145f27bc2397dc83b35f2f80f94fca81cc24f664dc62
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-143540
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cbea29996db443ce7a81623a6c3cd51b572817fc31709ec8607ecb4c99d401e5
Associated tags:
- 20230413-143540
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-143540
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-143540].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cbea29996db443ce7a81623a6c3cd51b572817fc31709ec8607ecb4c99d401e5].
$ rm -rf /tmp/tmp.NxsqVlolD5
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413142105
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7bcd4a70dabafd9171d0fd4ce582a0e35e7e45bc089e61ca522d02e33bdec872
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413142105]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7bcd4a70dabafd9171d0fd4ce582a0e35e7e45bc089e61ca522d02e33bdec872]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413142105] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7bcd4a70dabafd9171d0fd4ce582a0e35e7e45bc089e61ca522d02e33bdec872])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7bcd4a70dabafd9171d0fd4ce582a0e35e7e45bc089e61ca522d02e33bdec872
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7bcd4a70dabafd9171d0fd4ce582a0e35e7e45bc089e61ca522d02e33bdec872
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7bcd4a70dabafd9171d0fd4ce582a0e35e7e45bc089e61ca522d02e33bdec872].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413142105
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:62eeeaf9c54079f53f6e9f891c25d57aa90b2422943426f81e62c8563f625f3d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413142105]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:62eeeaf9c54079f53f6e9f891c25d57aa90b2422943426f81e62c8563f625f3d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413142105] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:62eeeaf9c54079f53f6e9f891c25d57aa90b2422943426f81e62c8563f625f3d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:62eeeaf9c54079f53f6e9f891c25d57aa90b2422943426f81e62c8563f625f3d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:62eeeaf9c54079f53f6e9f891c25d57aa90b2422943426f81e62c8563f625f3d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:62eeeaf9c54079f53f6e9f891c25d57aa90b2422943426f81e62c8563f625f3d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3782280.
Stopping expansion service pid: 3782281.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 40s
232 actionable tasks: 167 executed, 53 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/7gqilsim2hhfi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1520
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1520/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-083251",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413082031",
"environmentId": "kPXeJVNhwybeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-083251"
}
]
},
"name": "go-testxlang_partition-756",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/13 09:18:25 Submitted job: 2023-04-13_02_18_24-14463588401863861155
2023/04/13 09:18:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-13_02_18_24-14463588401863861155?project=apache-beam-testing
2023/04/13 09:18:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-13_02_18_24-14463588401863861155
2023/04/13 09:18:25 Job state: JOB_STATE_PENDING ...
2023/04/13 09:18:55 Job still running ...
2023/04/13 09:19:25 Job still running ...
2023/04/13 09:19:55 Job still running ...
2023/04/13 09:20:25 Job still running ...
2023/04/13 09:20:55 Job still running ...
2023/04/13 09:21:25 Job still running ...
2023/04/13 09:21:55 Job still running ...
2023/04/13 09:22:25 Job still running ...
2023/04/13 09:22:55 Job still running ...
2023/04/13 09:23:25 Job still running ...
2023/04/13 09:23:55 Job still running ...
2023/04/13 09:24:25 Job still running ...
2023/04/13 09:24:55 Job still running ...
2023/04/13 09:25:25 Job still running ...
2023/04/13 09:25:55 Job still running ...
2023/04/13 09:26:25 Job still running ...
2023/04/13 09:26:55 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-13_02_18_24-14463588401863861155 failed
--- FAIL: TestXLang_Partition (553.19s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3243.580s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681374805485974121
--- FAIL: TestBigQueryIO_BasicWriteRead (4.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34951 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gdwZWAMQHD" is_bounded:BOUNDED windowing_strategy_id:"w0@gdwZWAMQHD"}} windowing_strategies:{key:"w0@gdwZWAMQHD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gdwZWAMQHD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gdwZWAMQHD" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gdwZWAMQHD" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681374805485974121\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gdwZWAMQHD"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34951 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gdwZWAMQHD" is_bounded:BOUNDED windowing_strategy_id:"w0@gdwZWAMQHD"}} windowing_strategies:{key:"w0@gdwZWAMQHD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gdwZWAMQHD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gdwZWAMQHD" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gdwZWAMQHD" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681374805485974121\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gdwZWAMQHD"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 23 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0002b48c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0002b48c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005c8080?, 0xc0005ca000?}, {0x11c4aa8, 0x39}, {0xc0000f20c0?, 0x10c4960?, 0xc0005bc0c0?}, {0xc00046de90, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005c8020?, 0xc0005ca000?}, {0xc00004ede0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00046de90, 0xf}, {0xc00004ede0, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004d5860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004d5860, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.467s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d5cf88f10bc66beea83574d4cf559cfe68e8e2ddc3b91572acec234232252e70
Associated tags:
- 20230413-083251
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-083251
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-083251].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:d5cf88f10bc66beea83574d4cf559cfe68e8e2ddc3b91572acec234232252e70].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bb55b8871229610f8c54623609fbc79bb6390972ff5f7ad5f9744371e9c62ff]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bb55b8871229610f8c54623609fbc79bb6390972ff5f7ad5f9744371e9c62ff])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bb55b8871229610f8c54623609fbc79bb6390972ff5f7ad5f9744371e9c62ff
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9bb55b8871229610f8c54623609fbc79bb6390972ff5f7ad5f9744371e9c62ff].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34b5a4265bb21393c701b1a30f1dde96c0d3d8128e1016789180929da7cddf38]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34b5a4265bb21393c701b1a30f1dde96c0d3d8128e1016789180929da7cddf38])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34b5a4265bb21393c701b1a30f1dde96c0d3d8128e1016789180929da7cddf38
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:34b5a4265bb21393c701b1a30f1dde96c0d3d8128e1016789180929da7cddf38].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 24s
232 actionable tasks: 195 executed, 27 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/pz4mm733aj26a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1519
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1519/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413022040",
"environmentId": "ZzUDQhKVuSbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-023116"
}
]
},
"name": "go-testxlang_partition-514",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/13 03:16:42 Submitted job: 2023-04-12_20_16_42-9491263252161328644
2023/04/13 03:16:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-12_20_16_42-9491263252161328644?project=apache-beam-testing
2023/04/13 03:16:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-12_20_16_42-9491263252161328644
2023/04/13 03:16:42 Job state: JOB_STATE_PENDING ...
2023/04/13 03:17:13 Job still running ...
2023/04/13 03:17:43 Job still running ...
2023/04/13 03:18:13 Job still running ...
2023/04/13 03:18:43 Job still running ...
2023/04/13 03:19:13 Job still running ...
2023/04/13 03:19:43 Job still running ...
2023/04/13 03:20:13 Job still running ...
2023/04/13 03:20:43 Job still running ...
2023/04/13 03:21:13 Job still running ...
2023/04/13 03:21:43 Job still running ...
2023/04/13 03:22:13 Job still running ...
2023/04/13 03:22:43 Job still running ...
2023/04/13 03:23:13 Job still running ...
2023/04/13 03:23:43 Job still running ...
2023/04/13 03:24:13 Job still running ...
2023/04/13 03:24:43 Job still running ...
2023/04/13 03:25:13 Job still running ...
2023/04/13 03:25:43 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-12_20_16_42-9491263252161328644 failed
--- FAIL: TestXLang_Partition (581.71s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3267.943s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681353109920032582
--- FAIL: TestBigQueryIO_BasicWriteRead (5.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36889 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dEyzqtIjmB" is_bounded:BOUNDED windowing_strategy_id:"w0@dEyzqtIjmB"}} windowing_strategies:{key:"w0@dEyzqtIjmB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dEyzqtIjmB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dEyzqtIjmB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dEyzqtIjmB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681353109920032582\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dEyzqtIjmB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36889 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dEyzqtIjmB" is_bounded:BOUNDED windowing_strategy_id:"w0@dEyzqtIjmB"}} windowing_strategies:{key:"w0@dEyzqtIjmB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dEyzqtIjmB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dEyzqtIjmB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dEyzqtIjmB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681353109920032582\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dEyzqtIjmB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00040a780})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00040a780})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a80a0?, 0xc0000be050?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc0004f40c0?}, {0xc000489f70, 0xf}, 0xc000299d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a8040?, 0xc0000be050?}, {0xc00010eba0, 0x52}, {0x1?}, {0xc000299ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000489f70, 0xf}, {0xc00010eba0, 0x52}, {0xf21600, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031f520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031f520, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.467s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.038s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-023116
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-023116
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ad38d60c62c97a6c3caa5bb632bf2f36b8ff0e7e3c7ca0b2c502bb927b558458
Deleted: sha256:581b7eb3138cc6c1aef3842ffefc2dee5a763e6ac504f8eca72d6f711d693717
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-023116
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ad38d60c62c97a6c3caa5bb632bf2f36b8ff0e7e3c7ca0b2c502bb927b558458
Associated tags:
- 20230413-023116
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-023116
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230413-023116].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ad38d60c62c97a6c3caa5bb632bf2f36b8ff0e7e3c7ca0b2c502bb927b558458].
$ rm -rf /tmp/tmp.DFTkd5oF7x
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:35755725e04efe97ac0d205888dad039c30222af43f3565d73c977ac61f27a1a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:35755725e04efe97ac0d205888dad039c30222af43f3565d73c977ac61f27a1a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230413022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:35755725e04efe97ac0d205888dad039c30222af43f3565d73c977ac61f27a1a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:35755725e04efe97ac0d205888dad039c30222af43f3565d73c977ac61f27a1a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:35755725e04efe97ac0d205888dad039c30222af43f3565d73c977ac61f27a1a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:35755725e04efe97ac0d205888dad039c30222af43f3565d73c977ac61f27a1a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c45b592486f7a13b16474623b0ba1e14c6a0b3b3f3baac0dab061899f2539c71
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c45b592486f7a13b16474623b0ba1e14c6a0b3b3f3baac0dab061899f2539c71]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230413022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c45b592486f7a13b16474623b0ba1e14c6a0b3b3f3baac0dab061899f2539c71])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c45b592486f7a13b16474623b0ba1e14c6a0b3b3f3baac0dab061899f2539c71
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c45b592486f7a13b16474623b0ba1e14c6a0b3b3f3baac0dab061899f2539c71
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c45b592486f7a13b16474623b0ba1e14c6a0b3b3f3baac0dab061899f2539c71].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2243624.
Stopping expansion service pid: 2243625.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/qf6sqasxrlrj4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1518
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1518/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412202430",
"environmentId": "OYvMZHEgxXbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-203617",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-203617"
}
]
},
"name": "go-testxlang_partition-999",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/12 21:13:56 Submitted job: 2023-04-12_14_13_55-1180186350246054245
2023/04/12 21:13:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-12_14_13_55-1180186350246054245?project=apache-beam-testing
2023/04/12 21:13:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-12_14_13_55-1180186350246054245
2023/04/12 21:13:56 Job state: JOB_STATE_PENDING ...
2023/04/12 21:14:26 Job state: JOB_STATE_PENDING ...
ptest.go:108: Failed to execute job: Job 2023-04-12_14_13_55-1180186350246054245 failed
--- FAIL: TestXLang_Partition (82.05s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2233.085s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681331880541775574
--- FAIL: TestBigQueryIO_BasicWriteRead (12.86s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35963 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@fdNCedwWYG" is_bounded:BOUNDED windowing_strategy_id:"w0@fdNCedwWYG"}} windowing_strategies:{key:"w0@fdNCedwWYG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@fdNCedwWYG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@fdNCedwWYG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@fdNCedwWYG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681331880541775574\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"fdNCedwWYG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35963 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@fdNCedwWYG" is_bounded:BOUNDED windowing_strategy_id:"w0@fdNCedwWYG"}} windowing_strategies:{key:"w0@fdNCedwWYG" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@fdNCedwWYG" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@fdNCedwWYG" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@fdNCedwWYG" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681331880541775574\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"fdNCedwWYG"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 38 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc0000c4900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc0000c4900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00067ebe0?, 0xc0000be0f0?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc0000b2390?}, {0xc000569ec0, 0xf}, 0xc000153d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00067eb80?, 0xc0000be0f0?}, {0xc000534840, 0x52}, {0x1?}, {0xc000153ea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000569ec0, 0xf}, {0xc000534840, 0x52}, {0xf21600, 0xc000045280})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000503a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000503a00, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 15.962s
=== RUN TestDebeziumIO_BasicRead
integration.go:310: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.130s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:310: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:310: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.120s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:310: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.125s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-203617
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-203617
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1b3f663630953bd9d2cbfb8d90606dbe4867ccfac46c53a08f4df98e0bd6c017
Deleted: sha256:018dae8dc3c80fd13e4d32e7da4876904f27e292700029636523a26ede5a9d82
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-203617
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1b3f663630953bd9d2cbfb8d90606dbe4867ccfac46c53a08f4df98e0bd6c017
Associated tags:
- 20230412-203617
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-203617
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-203617].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1b3f663630953bd9d2cbfb8d90606dbe4867ccfac46c53a08f4df98e0bd6c017].
$ rm -rf /tmp/tmp.jVTae70uKn
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412202430
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:25f56e53eaa9e5ade550737437103f4b9efc58c74fcbbd9dcc6040937cf47cc2
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412202430]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:25f56e53eaa9e5ade550737437103f4b9efc58c74fcbbd9dcc6040937cf47cc2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412202430] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:25f56e53eaa9e5ade550737437103f4b9efc58c74fcbbd9dcc6040937cf47cc2])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:25f56e53eaa9e5ade550737437103f4b9efc58c74fcbbd9dcc6040937cf47cc2
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:25f56e53eaa9e5ade550737437103f4b9efc58c74fcbbd9dcc6040937cf47cc2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:25f56e53eaa9e5ade550737437103f4b9efc58c74fcbbd9dcc6040937cf47cc2].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412202430
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:705adead8d0ab36dc41f023f3246126aabc766d5804a1ca01e2445257359d67d
Deleted: sha256:119faef287cbe41cca09512ead85769e58ef19eb4862ded15809916914cb7dfb
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412202430]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:705adead8d0ab36dc41f023f3246126aabc766d5804a1ca01e2445257359d67d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412202430] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:705adead8d0ab36dc41f023f3246126aabc766d5804a1ca01e2445257359d67d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:705adead8d0ab36dc41f023f3246126aabc766d5804a1ca01e2445257359d67d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:705adead8d0ab36dc41f023f3246126aabc766d5804a1ca01e2445257359d67d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:705adead8d0ab36dc41f023f3246126aabc766d5804a1ca01e2445257359d67d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1699645.
Stopping expansion service pid: 1699646.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 51m
232 actionable tasks: 160 executed, 60 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/3y55m6rbulvhu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1517
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1517/display/redirect?page=changes>
Changes:
[noreply] Bump github.com/fsouza/fake-gcs-server from 1.44.1 to 1.44.2 in /sdks
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-144419",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-144419"
}
]
},
"name": "go-testxlang_partition-239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/12 15:28:46 Submitted job: 2023-04-12_08_28_46-15237578436303286399
2023/04/12 15:28:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-12_08_28_46-15237578436303286399?project=apache-beam-testing
2023/04/12 15:28:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-12_08_28_46-15237578436303286399
2023/04/12 15:28:47 Job state: JOB_STATE_PENDING ...
2023/04/12 15:29:17 Job still running ...
2023/04/12 15:29:47 Job still running ...
2023/04/12 15:30:17 Job still running ...
2023/04/12 15:30:47 Job still running ...
2023/04/12 15:31:17 Job still running ...
2023/04/12 15:31:47 Job still running ...
2023/04/12 15:32:17 Job still running ...
2023/04/12 15:32:47 Job still running ...
2023/04/12 15:33:17 Job still running ...
2023/04/12 15:33:47 Job still running ...
2023/04/12 15:34:17 Job still running ...
2023/04/12 15:34:47 Job still running ...
2023/04/12 15:35:17 Job still running ...
2023/04/12 15:35:47 Job still running ...
2023/04/12 15:36:17 Job still running ...
2023/04/12 15:36:47 Job still running ...
2023/04/12 15:37:17 Job still running ...
2023/04/12 15:37:47 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-12_08_28_46-15237578436303286399 failed
--- FAIL: TestXLang_Partition (582.00s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3192.835s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681310714522899905
--- FAIL: TestBigQueryIO_BasicWriteRead (6.86s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41807 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NTkEpaHGeD" is_bounded:BOUNDED windowing_strategy_id:"w0@NTkEpaHGeD"}} windowing_strategies:{key:"w0@NTkEpaHGeD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NTkEpaHGeD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NTkEpaHGeD" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NTkEpaHGeD" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681310714522899905\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NTkEpaHGeD"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41807 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NTkEpaHGeD" is_bounded:BOUNDED windowing_strategy_id:"w0@NTkEpaHGeD"}} windowing_strategies:{key:"w0@NTkEpaHGeD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NTkEpaHGeD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NTkEpaHGeD" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NTkEpaHGeD" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681310714522899905\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NTkEpaHGeD"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xfdca80, 0xc00002a240})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xfdca80, 0xc00002a240})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000168200?, 0xc00061e000?}, {0x11c4aa8, 0x39}, {0xc0001560c0?, 0x10c4960?, 0xc000492390?}, {0xc000045f50, 0xf}, 0xc0002abd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000168160?, 0xc00061e000?}, {0xc00004e9c0, 0x52}, {0x1?}, {0xc0002abea8, 0x2, 0xedcb60?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000045f50, 0xf}, {0xc00004e9c0, 0x52}, {0xf21600, 0xc00012c078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000603520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000603520, 0x11f78e8)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.900s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.046s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.032s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-144419
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-144419
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:566d99286fc352ad78874c8cd422fb4f1d7c1d70cb1433bf0d604f33b2ac541f
Deleted: sha256:5d484a1bcdac526299cfc3cc7662336bce5299f1246a1510d63c7e549f45bde9
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-144419
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:566d99286fc352ad78874c8cd422fb4f1d7c1d70cb1433bf0d604f33b2ac541f
Associated tags:
- 20230412-144419
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-144419
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-144419].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:566d99286fc352ad78874c8cd422fb4f1d7c1d70cb1433bf0d604f33b2ac541f].
$ rm -rf /tmp/tmp.vlOJufqYDU
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412142912
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3394a42c6f1f2959597b69b5daac6f8df843a2dc33458d61bec79c482abb6dcb
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412142912]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3394a42c6f1f2959597b69b5daac6f8df843a2dc33458d61bec79c482abb6dcb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412142912] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3394a42c6f1f2959597b69b5daac6f8df843a2dc33458d61bec79c482abb6dcb])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3394a42c6f1f2959597b69b5daac6f8df843a2dc33458d61bec79c482abb6dcb
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3394a42c6f1f2959597b69b5daac6f8df843a2dc33458d61bec79c482abb6dcb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3394a42c6f1f2959597b69b5daac6f8df843a2dc33458d61bec79c482abb6dcb].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412142912
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:73c45e0dba579a2ddb7b225f659f21207c18d23f2aa9a2f261326ef27574ecee
Deleted: sha256:7a6afda858cf4457f4197713b600067d222b86e39175bb3961445097f332328a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412142912]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:73c45e0dba579a2ddb7b225f659f21207c18d23f2aa9a2f261326ef27574ecee]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412142912] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:73c45e0dba579a2ddb7b225f659f21207c18d23f2aa9a2f261326ef27574ecee])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:95e32d2ccc840dc9cffb463d94a49461f6b11d92c4ccbf6e451856ee906dd7d2
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:95e32d2ccc840dc9cffb463d94a49461f6b11d92c4ccbf6e451856ee906dd7d2
ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Wed, 12 Apr 2023 15:38:42 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404}
Failed to compute blob liveness for manifest: 'sha256:95e32d2ccc840dc9cffb463d94a49461f6b11d92c4ccbf6e451856ee906dd7d2': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3989937.
Stopping expansion service pid: 3989938.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 306
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 48s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/2pmi5eci2oiv4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1516
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1516/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"environmentId": "JiRBbRZEqSbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-083235",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-083235"
}
]
},
"name": "go-testxlang_partition-226",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/12 09:18:38 Submitted job: 2023-04-12_02_18_37-17536846346018702254
2023/04/12 09:18:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-12_02_18_37-17536846346018702254?project=apache-beam-testing
2023/04/12 09:18:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-12_02_18_37-17536846346018702254
2023/04/12 09:18:38 Job state: JOB_STATE_PENDING ...
2023/04/12 09:19:08 Job still running ...
2023/04/12 09:19:38 Job still running ...
2023/04/12 09:20:08 Job still running ...
2023/04/12 09:20:38 Job still running ...
2023/04/12 09:21:08 Job still running ...
2023/04/12 09:21:38 Job still running ...
2023/04/12 09:22:08 Job still running ...
2023/04/12 09:22:38 Job still running ...
2023/04/12 09:23:08 Job still running ...
2023/04/12 09:23:38 Job still running ...
2023/04/12 09:24:09 Job still running ...
2023/04/12 09:24:39 Job still running ...
2023/04/12 09:25:09 Job still running ...
2023/04/12 09:25:39 Job still running ...
2023/04/12 09:26:09 Job still running ...
2023/04/12 09:26:39 Job still running ...
2023/04/12 09:27:09 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-12_02_18_37-17536846346018702254 failed
--- FAIL: TestXLang_Partition (550.57s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3271.081s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681288391763734674
--- FAIL: TestBigQueryIO_BasicWriteRead (4.96s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46633 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@HUCQqgUoaQ" is_bounded:BOUNDED windowing_strategy_id:"w0@HUCQqgUoaQ"}} windowing_strategies:{key:"w0@HUCQqgUoaQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@HUCQqgUoaQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@HUCQqgUoaQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@HUCQqgUoaQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681288391763734674\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"HUCQqgUoaQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46633 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@HUCQqgUoaQ" is_bounded:BOUNDED windowing_strategy_id:"w0@HUCQqgUoaQ"}} windowing_strategies:{key:"w0@HUCQqgUoaQ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@HUCQqgUoaQ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@HUCQqgUoaQ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@HUCQqgUoaQ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681288391763734674\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"HUCQqgUoaQ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf71bc0, 0xc0006e0c80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf71bc0, 0xc0006e0c80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00048f680?, 0xc0004b4960?}, {0x113ecee, 0x39}, {0xc0000f20c0?, 0x104cf60?, 0xc0004b8d50?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00048f620?, 0xc0004b4960?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7d8c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebeec0, 0xc0004f0270})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x1171210)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.983s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.019s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-083235
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-083235
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4032c0c71efd7968ef77784f3b8875d032143a6c8b4921acd3d61cebec3553cc
Deleted: sha256:354375a88af8cc8a9ad5b35009e55a4a24d4d7cbd679913b05221399a65ca0db
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-083235
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4032c0c71efd7968ef77784f3b8875d032143a6c8b4921acd3d61cebec3553cc
Associated tags:
- 20230412-083235
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-083235
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-083235].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4032c0c71efd7968ef77784f3b8875d032143a6c8b4921acd3d61cebec3553cc].
$ rm -rf /tmp/tmp.k0PWSNrAM5
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412082045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:44778072c2f9f0987f5be3c3cac288ba45cffdf1bb112044e179f2a2d64bef3c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412082045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:44778072c2f9f0987f5be3c3cac288ba45cffdf1bb112044e179f2a2d64bef3c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412082045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:44778072c2f9f0987f5be3c3cac288ba45cffdf1bb112044e179f2a2d64bef3c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:44778072c2f9f0987f5be3c3cac288ba45cffdf1bb112044e179f2a2d64bef3c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:44778072c2f9f0987f5be3c3cac288ba45cffdf1bb112044e179f2a2d64bef3c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:44778072c2f9f0987f5be3c3cac288ba45cffdf1bb112044e179f2a2d64bef3c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412082045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55c0958a752376d00fc88b1caa001a43f9f3feaf332e59a92c91cbba523d2424
Deleted: sha256:b2d49657e1fb1b9ef9ec2d5b9520f183a2d9a7fa6a7ce10f91a58d2a4d9fa421
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412082045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55c0958a752376d00fc88b1caa001a43f9f3feaf332e59a92c91cbba523d2424]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412082045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55c0958a752376d00fc88b1caa001a43f9f3feaf332e59a92c91cbba523d2424])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55c0958a752376d00fc88b1caa001a43f9f3feaf332e59a92c91cbba523d2424
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55c0958a752376d00fc88b1caa001a43f9f3feaf332e59a92c91cbba523d2424
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55c0958a752376d00fc88b1caa001a43f9f3feaf332e59a92c91cbba523d2424].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 500513.
Stopping expansion service pid: 500514.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 23s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/wzbzlgbvkwtvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1515
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1515/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412022040",
"environmentId": "qyLQnTpXbabeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-023104",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-023104"
}
]
},
"name": "go-testxlang_partition-71",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/12 03:15:26 Submitted job: 2023-04-11_20_15_25-17905605894787268352
2023/04/12 03:15:26 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-11_20_15_25-17905605894787268352?project=apache-beam-testing
2023/04/12 03:15:26 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-11_20_15_25-17905605894787268352
2023/04/12 03:15:26 Job state: JOB_STATE_PENDING ...
2023/04/12 03:15:56 Job still running ...
2023/04/12 03:16:26 Job still running ...
2023/04/12 03:16:56 Job still running ...
2023/04/12 03:17:26 Job still running ...
2023/04/12 03:17:56 Job still running ...
2023/04/12 03:18:26 Job still running ...
2023/04/12 03:18:56 Job still running ...
2023/04/12 03:19:26 Job still running ...
2023/04/12 03:19:56 Job still running ...
2023/04/12 03:20:26 Job still running ...
2023/04/12 03:20:56 Job still running ...
2023/04/12 03:21:26 Job still running ...
2023/04/12 03:21:56 Job still running ...
2023/04/12 03:22:26 Job still running ...
2023/04/12 03:22:56 Job still running ...
2023/04/12 03:23:26 Job still running ...
2023/04/12 03:23:57 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-11_20_15_25-17905605894787268352 failed
--- FAIL: TestXLang_Partition (549.91s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3174.485s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681266696116737399
--- FAIL: TestBigQueryIO_BasicWriteRead (4.72s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45569 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@UeOlEZuXfZ" is_bounded:BOUNDED windowing_strategy_id:"w0@UeOlEZuXfZ"}} windowing_strategies:{key:"w0@UeOlEZuXfZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@UeOlEZuXfZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UeOlEZuXfZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@UeOlEZuXfZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681266696116737399\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"UeOlEZuXfZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45569 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@UeOlEZuXfZ" is_bounded:BOUNDED windowing_strategy_id:"w0@UeOlEZuXfZ"}} windowing_strategies:{key:"w0@UeOlEZuXfZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@UeOlEZuXfZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UeOlEZuXfZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@UeOlEZuXfZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681266696116737399\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"UeOlEZuXfZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf71bc0, 0xc00048c300})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf71bc0, 0xc00048c300})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00048f640?, 0xc00012e000?}, {0x113ecee, 0x39}, {0xc0000f20c0?, 0x104cf60?, 0xc0004b8cf0?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012e000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7d8c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebeec0, 0xc000126008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x1171210)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.742s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.022s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.023s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b097787836428b2ff063fb6c3fac54d0b313d1b7d06f85600052a37da40e00be
Associated tags:
- 20230412-023104
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-023104
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230412-023104].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b097787836428b2ff063fb6c3fac54d0b313d1b7d06f85600052a37da40e00be].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4abb103d23d53be1c98daba3587e6613053f68b32710a373078b846ce50a2f94]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230412022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4abb103d23d53be1c98daba3587e6613053f68b32710a373078b846ce50a2f94])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4abb103d23d53be1c98daba3587e6613053f68b32710a373078b846ce50a2f94
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4abb103d23d53be1c98daba3587e6613053f68b32710a373078b846ce50a2f94].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:385efdc3bf536f5cf71fb00bda06e76ee1364a83bb0769f280c06c87c8795161]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230412022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:385efdc3bf536f5cf71fb00bda06e76ee1364a83bb0769f280c06c87c8795161])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:385efdc3bf536f5cf71fb00bda06e76ee1364a83bb0769f280c06c87c8795161
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:385efdc3bf536f5cf71fb00bda06e76ee1364a83bb0769f280c06c87c8795161].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 12s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ebw5ly42yhjww
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1514
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1514/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-203149",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-203149"
}
]
},
"name": "go-testxlang_partition-579",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/11 21:17:29 Submitted job: 2023-04-11_14_17_29-4039973228992662773
2023/04/11 21:17:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-11_14_17_29-4039973228992662773?project=apache-beam-testing
2023/04/11 21:17:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-11_14_17_29-4039973228992662773
2023/04/11 21:17:29 Job state: JOB_STATE_PENDING ...
2023/04/11 21:17:59 Job still running ...
2023/04/11 21:18:29 Job still running ...
2023/04/11 21:18:59 Job still running ...
2023/04/11 21:19:29 Job still running ...
2023/04/11 21:19:59 Job still running ...
2023/04/11 21:20:29 Job still running ...
2023/04/11 21:20:59 Job still running ...
2023/04/11 21:21:29 Job still running ...
2023/04/11 21:21:59 Job still running ...
2023/04/11 21:22:30 Job still running ...
2023/04/11 21:23:00 Job still running ...
2023/04/11 21:23:30 Job still running ...
2023/04/11 21:24:00 Job still running ...
2023/04/11 21:24:30 Job still running ...
2023/04/11 21:25:00 Job still running ...
2023/04/11 21:25:30 Job still running ...
2023/04/11 21:26:00 Job still running ...
2023/04/11 21:26:30 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-11_14_17_29-4039973228992662773 failed
--- FAIL: TestXLang_Partition (581.56s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3271.560s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681245156366961579
--- FAIL: TestBigQueryIO_BasicWriteRead (6.83s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42643 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@rMDbrCaHcO" is_bounded:BOUNDED windowing_strategy_id:"w0@rMDbrCaHcO"}} windowing_strategies:{key:"w0@rMDbrCaHcO" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@rMDbrCaHcO" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@rMDbrCaHcO" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@rMDbrCaHcO" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681245156366961579\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"rMDbrCaHcO"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42643 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@rMDbrCaHcO" is_bounded:BOUNDED windowing_strategy_id:"w0@rMDbrCaHcO"}} windowing_strategies:{key:"w0@rMDbrCaHcO" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@rMDbrCaHcO" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@rMDbrCaHcO" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@rMDbrCaHcO" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681245156366961579\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"rMDbrCaHcO"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 21 [running]:
testing.tRunner.func1.2({0xf71bc0, 0xc0004a2300})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf71bc0, 0xc0004a2300})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a81a0?, 0xc0004ca870?}, {0x113ecee, 0x39}, {0xc000158180?, 0x104cf60?, 0xc0000ba420?}, {0xc00049eea0, 0xf}, 0xc000155d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a8140?, 0xc0004ca870?}, {0xc00004e360, 0x52}, {0x1?}, {0xc000155ea8, 0x2, 0xe7d8c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00049eea0, 0xf}, {0xc00004e360, 0x52}, {0xebeec0, 0xc0000445d8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031d860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031d860, 0x1171210)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.851s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-203149
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-203149
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8e1d5a424cec24c7e9b5b371f1cc2675477028ed9e5d7a35aa557574c34426b8
Deleted: sha256:285446db9107fd200f1ba5a19aa9cd0c3e1d80c1afdc3f2cfda7a434cf4404c3
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-203149
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8e1d5a424cec24c7e9b5b371f1cc2675477028ed9e5d7a35aa557574c34426b8
Associated tags:
- 20230411-203149
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-203149
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-203149].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8e1d5a424cec24c7e9b5b371f1cc2675477028ed9e5d7a35aa557574c34426b8].
$ rm -rf /tmp/tmp.Q3yhJJ5sBR
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411202031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:df3156cf67107383c19dbb851348bc5e268ed17d4f007e740c97ca14c46e9cc3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:df3156cf67107383c19dbb851348bc5e268ed17d4f007e740c97ca14c46e9cc3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:df3156cf67107383c19dbb851348bc5e268ed17d4f007e740c97ca14c46e9cc3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:df3156cf67107383c19dbb851348bc5e268ed17d4f007e740c97ca14c46e9cc3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:df3156cf67107383c19dbb851348bc5e268ed17d4f007e740c97ca14c46e9cc3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:df3156cf67107383c19dbb851348bc5e268ed17d4f007e740c97ca14c46e9cc3].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411202031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11273a035eeb539687949b5fd9c209ea5fb8d93459203b579d599eeae729e398
Deleted: sha256:613742bdb59b9238a53cff54349f88799e9cd227c12d9d6bd9d32cc4cf26c59d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11273a035eeb539687949b5fd9c209ea5fb8d93459203b579d599eeae729e398]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11273a035eeb539687949b5fd9c209ea5fb8d93459203b579d599eeae729e398])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11273a035eeb539687949b5fd9c209ea5fb8d93459203b579d599eeae729e398
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11273a035eeb539687949b5fd9c209ea5fb8d93459203b579d599eeae729e398
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11273a035eeb539687949b5fd9c209ea5fb8d93459203b579d599eeae729e398].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3454439.
Stopping expansion service pid: 3454440.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 55s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/hnez6jetlcgk2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1513
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1513/display/redirect?page=changes>
Changes:
[noreply] [Python] Fix typos in doc (#26218)
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-143122",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411142041",
"environmentId": "QmtePtyFHMbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-143122"
}
]
},
"name": "go-testxlang_partition-533",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/11 15:15:51 Submitted job: 2023-04-11_08_15_50-16561358115801621638
2023/04/11 15:15:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-11_08_15_50-16561358115801621638?project=apache-beam-testing
2023/04/11 15:15:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-11_08_15_50-16561358115801621638
2023/04/11 15:15:51 Job state: JOB_STATE_PENDING ...
2023/04/11 15:16:21 Job still running ...
2023/04/11 15:16:51 Job still running ...
2023/04/11 15:17:21 Job still running ...
2023/04/11 15:17:51 Job still running ...
2023/04/11 15:18:21 Job still running ...
2023/04/11 15:18:51 Job still running ...
2023/04/11 15:19:21 Job still running ...
2023/04/11 15:19:51 Job still running ...
2023/04/11 15:20:21 Job still running ...
2023/04/11 15:20:51 Job still running ...
2023/04/11 15:21:21 Job still running ...
2023/04/11 15:21:51 Job still running ...
2023/04/11 15:22:21 Job still running ...
2023/04/11 15:22:52 Job still running ...
2023/04/11 15:23:22 Job still running ...
2023/04/11 15:23:52 Job still running ...
2023/04/11 15:24:22 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-11_08_15_50-16561358115801621638 failed
--- FAIL: TestXLang_Partition (550.38s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3176.319s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681223519195855265
--- FAIL: TestBigQueryIO_BasicWriteRead (4.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36851 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qjBhOKVnFj" is_bounded:BOUNDED windowing_strategy_id:"w0@qjBhOKVnFj"}} windowing_strategies:{key:"w0@qjBhOKVnFj" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qjBhOKVnFj" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qjBhOKVnFj" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qjBhOKVnFj" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681223519195855265\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qjBhOKVnFj"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36851 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qjBhOKVnFj" is_bounded:BOUNDED windowing_strategy_id:"w0@qjBhOKVnFj"}} windowing_strategies:{key:"w0@qjBhOKVnFj" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qjBhOKVnFj" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qjBhOKVnFj" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qjBhOKVnFj" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681223519195855265\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qjBhOKVnFj"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70520, 0xc000598600})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70520, 0xc000598600})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000514080?, 0xc000522000?}, {0x113d0b5, 0x39}, {0xc0004fe000?, 0x104b4c0?, 0xc0005060c0?}, {0xc000484f50, 0xf}, 0xc0000ebd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000514020?, 0xc000522000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000ebea8, 0x2, 0xe7c5e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000484f50, 0xf}, {0xc00004efc0, 0x52}, {0xebdae0, 0xc000516008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e6b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e6b60, 0x116f590)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.628s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:24e0784d00f6d608ef8f478431a5362bcbbf4070fe4266fc32e0ea860a4d93fa
Associated tags:
- 20230411-143122
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-143122
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-143122].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:24e0784d00f6d608ef8f478431a5362bcbbf4070fe4266fc32e0ea860a4d93fa].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f75bc8dc32bb14e85f89347274275f9c117a107a9b921c65c7bf4508bec49a5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f75bc8dc32bb14e85f89347274275f9c117a107a9b921c65c7bf4508bec49a5])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f75bc8dc32bb14e85f89347274275f9c117a107a9b921c65c7bf4508bec49a5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1f75bc8dc32bb14e85f89347274275f9c117a107a9b921c65c7bf4508bec49a5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:45a6c2c1a47b966835c0116e7bdcf1a245e18b3336991db3e8d3c8bfa63106dc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:45a6c2c1a47b966835c0116e7bdcf1a245e18b3336991db3e8d3c8bfa63106dc])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:45a6c2c1a47b966835c0116e7bdcf1a245e18b3336991db3e8d3c8bfa63106dc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:45a6c2c1a47b966835c0116e7bdcf1a245e18b3336991db3e8d3c8bfa63106dc].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 37s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/j3zqijkgwlphg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1512
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1512/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-083116",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411082040",
"environmentId": "YvddZpxzvKbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-083116"
}
]
},
"name": "go-testxlang_partition-386",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/11 09:15:54 Submitted job: 2023-04-11_02_15_54-6854771129538568326
2023/04/11 09:15:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-11_02_15_54-6854771129538568326?project=apache-beam-testing
2023/04/11 09:15:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-11_02_15_54-6854771129538568326
2023/04/11 09:15:54 Job state: JOB_STATE_PENDING ...
2023/04/11 09:16:25 Job still running ...
2023/04/11 09:16:55 Job still running ...
2023/04/11 09:17:25 Job still running ...
2023/04/11 09:17:55 Job still running ...
2023/04/11 09:18:25 Job still running ...
2023/04/11 09:18:55 Job still running ...
2023/04/11 09:19:25 Job still running ...
2023/04/11 09:19:55 Job still running ...
2023/04/11 09:20:25 Job still running ...
2023/04/11 09:20:55 Job still running ...
2023/04/11 09:21:25 Job still running ...
2023/04/11 09:21:55 Job still running ...
2023/04/11 09:22:25 Job still running ...
2023/04/11 09:22:55 Job still running ...
2023/04/11 09:23:25 Job still running ...
2023/04/11 09:23:55 Job still running ...
2023/04/11 09:24:25 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-11_02_15_54-6854771129538568326 failed
--- FAIL: TestXLang_Partition (549.88s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3186.227s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681201912747917127
--- FAIL: TestBigQueryIO_BasicWriteRead (4.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38337 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hozcFkFGVY" is_bounded:BOUNDED windowing_strategy_id:"w0@hozcFkFGVY"}} windowing_strategies:{key:"w0@hozcFkFGVY" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hozcFkFGVY" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hozcFkFGVY" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hozcFkFGVY" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681201912747917127\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hozcFkFGVY"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38337 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hozcFkFGVY" is_bounded:BOUNDED windowing_strategy_id:"w0@hozcFkFGVY"}} windowing_strategies:{key:"w0@hozcFkFGVY" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hozcFkFGVY" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hozcFkFGVY" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hozcFkFGVY" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681201912747917127\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hozcFkFGVY"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf70520, 0xc000515240})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70520, 0xc000515240})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a8440?, 0xc0004ca8c0?}, {0x113d0b5, 0x39}, {0xc000156180?, 0x104b4c0?, 0xc0000c0a50?}, {0xc0000440a0, 0xf}, 0xc000595d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a83e0?, 0xc0004ca8c0?}, {0xc00004e480, 0x52}, {0x1?}, {0xc000595ea8, 0x2, 0xe7c5e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440a0, 0xf}, {0xc00004e480, 0x52}, {0xebdae0, 0xc0000453d0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005824e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005824e0, 0x116f590)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.357s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.020s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7822c57464ea24d813d55f050fcfb7b293d9273cd5dd4ba6aac15f224f120e03
Associated tags:
- 20230411-083116
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-083116
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-083116].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7822c57464ea24d813d55f050fcfb7b293d9273cd5dd4ba6aac15f224f120e03].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:469abb62399683859a140a20eb41bba972be7f60d2997971ea3076abed889aea]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:469abb62399683859a140a20eb41bba972be7f60d2997971ea3076abed889aea])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:469abb62399683859a140a20eb41bba972be7f60d2997971ea3076abed889aea
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:469abb62399683859a140a20eb41bba972be7f60d2997971ea3076abed889aea].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:08053dffeaed11f3d6537935b876f3752e7c9c85d903307aff4a1c36329559cc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:08053dffeaed11f3d6537935b876f3752e7c9c85d903307aff4a1c36329559cc])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:08053dffeaed11f3d6537935b876f3752e7c9c85d903307aff4a1c36329559cc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:08053dffeaed11f3d6537935b876f3752e7c9c85d903307aff4a1c36329559cc].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 41s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/skp35n45vzr32
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1511
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1511/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411022045",
"environmentId": "xUaTRFzfpSbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-023125",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-023125"
}
]
},
"name": "go-testxlang_partition-938",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/11 03:15:49 Submitted job: 2023-04-10_20_15_49-7525860549391960887
2023/04/11 03:15:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-10_20_15_49-7525860549391960887?project=apache-beam-testing
2023/04/11 03:15:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-10_20_15_49-7525860549391960887
2023/04/11 03:15:49 Job state: JOB_STATE_PENDING ...
2023/04/11 03:16:19 Job still running ...
2023/04/11 03:16:49 Job still running ...
2023/04/11 03:17:19 Job still running ...
2023/04/11 03:17:49 Job still running ...
2023/04/11 03:18:19 Job still running ...
2023/04/11 03:18:49 Job still running ...
2023/04/11 03:19:19 Job still running ...
2023/04/11 03:19:49 Job still running ...
2023/04/11 03:20:20 Job still running ...
2023/04/11 03:20:50 Job still running ...
2023/04/11 03:21:20 Job still running ...
2023/04/11 03:21:50 Job still running ...
2023/04/11 03:22:20 Job still running ...
2023/04/11 03:22:50 Job still running ...
2023/04/11 03:23:20 Job still running ...
2023/04/11 03:23:50 Job still running ...
2023/04/11 03:24:20 Job still running ...
2023/04/11 03:24:50 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-10_20_15_49-7525860549391960887 failed
--- FAIL: TestXLang_Partition (580.13s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3205.500s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681180318818914446
--- FAIL: TestBigQueryIO_BasicWriteRead (5.34s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46369 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kuXtfmyhLb" is_bounded:BOUNDED windowing_strategy_id:"w0@kuXtfmyhLb"}} windowing_strategies:{key:"w0@kuXtfmyhLb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kuXtfmyhLb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kuXtfmyhLb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kuXtfmyhLb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681180318818914446\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kuXtfmyhLb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46369 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kuXtfmyhLb" is_bounded:BOUNDED windowing_strategy_id:"w0@kuXtfmyhLb"}} windowing_strategies:{key:"w0@kuXtfmyhLb" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kuXtfmyhLb" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kuXtfmyhLb" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kuXtfmyhLb" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681180318818914446\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kuXtfmyhLb"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xf70520, 0xc000416a40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70520, 0xc000416a40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004a4800?, 0xc0004ca910?}, {0x113d0b5, 0x39}, {0xc000156180?, 0x104b4c0?, 0xc0004ceb10?}, {0xc00049e380, 0xf}, 0xc0000ddd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004a4760?, 0xc0004ca910?}, {0xc00010e7e0, 0x52}, {0x1?}, {0xc0000ddea8, 0x2, 0xe7c5e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00049e380, 0xf}, {0xc00010e7e0, 0x52}, {0xebdae0, 0xc00049fab0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003221a0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003221a0, 0x116f590)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.365s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.034s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f39f0496b947aa93a1e25c8bd3bba20d039373ff42c15707f45574d2fa2727fd
Associated tags:
- 20230411-023125
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-023125
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230411-023125].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f39f0496b947aa93a1e25c8bd3bba20d039373ff42c15707f45574d2fa2727fd].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411022045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2af71b06ccacaacbfea45b4317fa83029f128168931e77b66e4cc5de9eabb003]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230411022045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2af71b06ccacaacbfea45b4317fa83029f128168931e77b66e4cc5de9eabb003])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2af71b06ccacaacbfea45b4317fa83029f128168931e77b66e4cc5de9eabb003
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2af71b06ccacaacbfea45b4317fa83029f128168931e77b66e4cc5de9eabb003].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411022045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:89029b43bffd259f1720eb9edbf0cae4d8983b14a03b4492289ce9faabdd83a6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230411022045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:89029b43bffd259f1720eb9edbf0cae4d8983b14a03b4492289ce9faabdd83a6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:89029b43bffd259f1720eb9edbf0cae4d8983b14a03b4492289ce9faabdd83a6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:89029b43bffd259f1720eb9edbf0cae4d8983b14a03b4492289ce9faabdd83a6].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 5s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/viu7bvevx64sk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1510
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1510/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410202039",
"environmentId": "wykexULIaVbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.48.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-203113",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-203113"
}
]
},
"name": "go-testxlang_partition-380",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/10 21:15:36 Submitted job: 2023-04-10_14_15_36-1586362178084198983
2023/04/10 21:15:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-10_14_15_36-1586362178084198983?project=apache-beam-testing
2023/04/10 21:15:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-10_14_15_36-1586362178084198983
2023/04/10 21:15:36 Job state: JOB_STATE_PENDING ...
2023/04/10 21:16:06 Job still running ...
2023/04/10 21:16:37 Job still running ...
2023/04/10 21:17:07 Job still running ...
2023/04/10 21:17:37 Job still running ...
2023/04/10 21:18:07 Job still running ...
2023/04/10 21:18:37 Job still running ...
2023/04/10 21:19:07 Job still running ...
2023/04/10 21:19:37 Job still running ...
2023/04/10 21:20:07 Job still running ...
2023/04/10 21:20:37 Job still running ...
2023/04/10 21:21:07 Job still running ...
2023/04/10 21:21:37 Job still running ...
2023/04/10 21:22:07 Job still running ...
2023/04/10 21:22:37 Job still running ...
2023/04/10 21:23:07 Job still running ...
2023/04/10 21:23:37 Job still running ...
2023/04/10 21:24:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-10_14_15_36-1586362178084198983 failed
--- FAIL: TestXLang_Partition (551.68s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3175.991s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681158708018096437
--- FAIL: TestBigQueryIO_BasicWriteRead (4.27s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46337 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ENNtNmJDRB" is_bounded:BOUNDED windowing_strategy_id:"w0@ENNtNmJDRB"}} windowing_strategies:{key:"w0@ENNtNmJDRB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ENNtNmJDRB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ENNtNmJDRB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ENNtNmJDRB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681158708018096437\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ENNtNmJDRB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46337 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ENNtNmJDRB" is_bounded:BOUNDED windowing_strategy_id:"w0@ENNtNmJDRB"}} windowing_strategies:{key:"w0@ENNtNmJDRB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ENNtNmJDRB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ENNtNmJDRB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ENNtNmJDRB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681158708018096437\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ENNtNmJDRB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 23 [running]:
testing.tRunner.func1.2({0xf70520, 0xc00058ccc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70520, 0xc00058ccc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004a4800?, 0xc0004ca8c0?}, {0x113d0b5, 0x39}, {0xc0001560c0?, 0x104b4c0?, 0xc0004ceae0?}, {0xc00049e380, 0xf}, 0xc0004ebd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004a4760?, 0xc0004ca8c0?}, {0xc00010e780, 0x52}, {0x1?}, {0xc0004ebea8, 0x2, 0xe7c5e0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00049e380, 0xf}, {0xc00010e780, 0x52}, {0xebdae0, 0xc00049faa0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003221a0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003221a0, 0x116f590)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.287s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.021s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.019s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-203113
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-203113
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b7f1cd3ca786e71233f024e139aa5b7dab73013f6cf90d490b67107e588cb333
Deleted: sha256:d681a5aff2fc6359b35b0f537ae301d8f4fe1e6270d0d8344c88ff88d908440c
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-203113
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b7f1cd3ca786e71233f024e139aa5b7dab73013f6cf90d490b67107e588cb333
Associated tags:
- 20230410-203113
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-203113
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-203113].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b7f1cd3ca786e71233f024e139aa5b7dab73013f6cf90d490b67107e588cb333].
$ rm -rf /tmp/tmp.tF4jFtAMF0
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410202039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6a38b301309fbfcd2192cf12cf9db807d45e13717f0f4540dc6e996013ddbf67
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6a38b301309fbfcd2192cf12cf9db807d45e13717f0f4540dc6e996013ddbf67]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6a38b301309fbfcd2192cf12cf9db807d45e13717f0f4540dc6e996013ddbf67])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6a38b301309fbfcd2192cf12cf9db807d45e13717f0f4540dc6e996013ddbf67
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6a38b301309fbfcd2192cf12cf9db807d45e13717f0f4540dc6e996013ddbf67
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6a38b301309fbfcd2192cf12cf9db807d45e13717f0f4540dc6e996013ddbf67].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410202039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:124a58468c865170f52f3840b6dc0dfa9477aeda469a8c47a08a9a05acfd1d4f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:124a58468c865170f52f3840b6dc0dfa9477aeda469a8c47a08a9a05acfd1d4f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:124a58468c865170f52f3840b6dc0dfa9477aeda469a8c47a08a9a05acfd1d4f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:124a58468c865170f52f3840b6dc0dfa9477aeda469a8c47a08a9a05acfd1d4f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:124a58468c865170f52f3840b6dc0dfa9477aeda469a8c47a08a9a05acfd1d4f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:124a58468c865170f52f3840b6dc0dfa9477aeda469a8c47a08a9a05acfd1d4f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2204240.
Stopping expansion service pid: 2204241.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 24s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/3ejruwe3fqihs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1509
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1509/display/redirect?page=changes>
Changes:
[noreply] Update release branch script to increment TypeScript version (#26148)
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410142040",
"environmentId": "oSmJLBfSYDbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-143708"
}
]
},
"name": "go-testxlang_partition-877",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/10 15:20:16 Submitted job: 2023-04-10_08_20_15-2635545010548161053
2023/04/10 15:20:16 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-10_08_20_15-2635545010548161053?project=apache-beam-testing
2023/04/10 15:20:16 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-10_08_20_15-2635545010548161053
2023/04/10 15:20:16 Job state: JOB_STATE_PENDING ...
2023/04/10 15:20:46 Job still running ...
2023/04/10 15:21:16 Job still running ...
2023/04/10 15:21:46 Job still running ...
2023/04/10 15:22:16 Job still running ...
2023/04/10 15:22:46 Job still running ...
2023/04/10 15:23:16 Job still running ...
2023/04/10 15:23:46 Job still running ...
2023/04/10 15:24:16 Job still running ...
2023/04/10 15:24:46 Job still running ...
2023/04/10 15:25:16 Job still running ...
2023/04/10 15:25:46 Job still running ...
2023/04/10 15:26:16 Job still running ...
2023/04/10 15:26:46 Job still running ...
2023/04/10 15:27:16 Job still running ...
2023/04/10 15:27:46 Job still running ...
2023/04/10 15:28:16 Job still running ...
2023/04/10 15:28:46 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-10_08_20_15-2635545010548161053 failed
--- FAIL: TestXLang_Partition (552.52s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3062.783s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681137497520959831
--- FAIL: TestBigQueryIO_BasicWriteRead (6.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46131 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@BRenZzLmjm" is_bounded:BOUNDED windowing_strategy_id:"w0@BRenZzLmjm"}} windowing_strategies:{key:"w0@BRenZzLmjm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@BRenZzLmjm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@BRenZzLmjm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@BRenZzLmjm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681137497520959831\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"BRenZzLmjm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46131 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@BRenZzLmjm" is_bounded:BOUNDED windowing_strategy_id:"w0@BRenZzLmjm"}} windowing_strategies:{key:"w0@BRenZzLmjm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@BRenZzLmjm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@BRenZzLmjm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@BRenZzLmjm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681137497520959831\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"BRenZzLmjm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0000b28c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0000b28c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e080?, 0xc000126000?}, {0x113d039, 0x39}, {0xc00015c000?, 0x104b4a0?, 0xc000110090?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e020?, 0xc000126000?}, {0xc00004efc0, 0x52}, {0x7fdff05f35b8?}, {0xc0000efea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc000124000})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.362s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-143708
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-143708
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4be5f062df217119be4fc71bec141456b63770725db91da0c7da07f28a3aaf1a
Deleted: sha256:42174ce2b2944fcadc5447bc106f1f8005a9b3b20eb56f33d81650a8936af158
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-143708
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4be5f062df217119be4fc71bec141456b63770725db91da0c7da07f28a3aaf1a
Associated tags:
- 20230410-143708
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-143708
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-143708].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4be5f062df217119be4fc71bec141456b63770725db91da0c7da07f28a3aaf1a].
$ rm -rf /tmp/tmp.G7C8wpjLEm
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2f45083d001c4b8e6eeaf582677b9e1965741fd8dabd7c2205a972405344b2b3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2f45083d001c4b8e6eeaf582677b9e1965741fd8dabd7c2205a972405344b2b3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2f45083d001c4b8e6eeaf582677b9e1965741fd8dabd7c2205a972405344b2b3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2f45083d001c4b8e6eeaf582677b9e1965741fd8dabd7c2205a972405344b2b3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2f45083d001c4b8e6eeaf582677b9e1965741fd8dabd7c2205a972405344b2b3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2f45083d001c4b8e6eeaf582677b9e1965741fd8dabd7c2205a972405344b2b3].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c87529fd454da75d71be1a5af5393fa3f1f09f53b84d5d3f460d6e8a196bd9dc
Deleted: sha256:afdd1063d86fed88da4dfe5766c9e6d28fefc650b840349c9bc6549fc8e36f9d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c87529fd454da75d71be1a5af5393fa3f1f09f53b84d5d3f460d6e8a196bd9dc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c87529fd454da75d71be1a5af5393fa3f1f09f53b84d5d3f460d6e8a196bd9dc])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c87529fd454da75d71be1a5af5393fa3f1f09f53b84d5d3f460d6e8a196bd9dc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c87529fd454da75d71be1a5af5393fa3f1f09f53b84d5d3f460d6e8a196bd9dc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c87529fd454da75d71be1a5af5393fa3f1f09f53b84d5d3f460d6e8a196bd9dc].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1618881.
Stopping expansion service pid: 1618882.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 2s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/qayr32bvuh6t4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1508
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1508/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410082026",
"environmentId": "HAwdADgTBebeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-083023"
}
]
},
"name": "go-testxlang_partition-666",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/10 09:14:43 Submitted job: 2023-04-10_02_14_43-14652146341887119794
2023/04/10 09:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-10_02_14_43-14652146341887119794?project=apache-beam-testing
2023/04/10 09:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-10_02_14_43-14652146341887119794
2023/04/10 09:14:43 Job state: JOB_STATE_PENDING ...
2023/04/10 09:15:13 Job still running ...
2023/04/10 09:15:43 Job still running ...
2023/04/10 09:16:13 Job still running ...
2023/04/10 09:16:43 Job still running ...
2023/04/10 09:17:13 Job still running ...
2023/04/10 09:17:43 Job still running ...
2023/04/10 09:18:13 Job still running ...
2023/04/10 09:18:43 Job still running ...
2023/04/10 09:19:14 Job still running ...
2023/04/10 09:19:44 Job still running ...
2023/04/10 09:20:14 Job still running ...
2023/04/10 09:20:44 Job still running ...
2023/04/10 09:21:14 Job still running ...
2023/04/10 09:21:44 Job still running ...
2023/04/10 09:22:14 Job still running ...
2023/04/10 09:22:44 Job still running ...
2023/04/10 09:23:14 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-10_02_14_43-14652146341887119794 failed
--- FAIL: TestXLang_Partition (549.48s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3170.667s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681115456885483329
--- FAIL: TestBigQueryIO_BasicWriteRead (4.22s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38281 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sYJnesoTBK" is_bounded:BOUNDED windowing_strategy_id:"w0@sYJnesoTBK"}} windowing_strategies:{key:"w0@sYJnesoTBK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sYJnesoTBK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sYJnesoTBK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sYJnesoTBK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681115456885483329\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sYJnesoTBK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38281 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sYJnesoTBK" is_bounded:BOUNDED windowing_strategy_id:"w0@sYJnesoTBK"}} windowing_strategies:{key:"w0@sYJnesoTBK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sYJnesoTBK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sYJnesoTBK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sYJnesoTBK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681115456885483329\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sYJnesoTBK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 39 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0004a04c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0004a04c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00059c0e0?, 0xc000180280?}, {0x113d039, 0x39}, {0xc0005f8000?, 0x104b4a0?, 0xc0004821b0?}, {0xc0000440a0, 0xf}, 0xc000123d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00059c020?, 0xc000180280?}, {0xc00004e480, 0x52}, {0x1?}, {0xc000123ea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440a0, 0xf}, {0xc00004e480, 0x52}, {0xebdac0, 0xc00049c038})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000007d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000007d40, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.245s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.022s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.019s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-083023
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-083023
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:525a9bc2b1bdec4dc58c47cc9877c9f92658b16640547e0c05540babf99ae71f
Deleted: sha256:434846ca5203109ec9effcc80ebf580e994b5d29f077d52c157223a13d21001f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-083023
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:525a9bc2b1bdec4dc58c47cc9877c9f92658b16640547e0c05540babf99ae71f
Associated tags:
- 20230410-083023
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-083023
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-083023].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:525a9bc2b1bdec4dc58c47cc9877c9f92658b16640547e0c05540babf99ae71f].
$ rm -rf /tmp/tmp.GIRQMHMo0V
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410082026
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:723dabf185c5391b2edddbfd51f29a68412f5e6d87e740d09d9de77ecf341782
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410082026]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:723dabf185c5391b2edddbfd51f29a68412f5e6d87e740d09d9de77ecf341782]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410082026] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:723dabf185c5391b2edddbfd51f29a68412f5e6d87e740d09d9de77ecf341782])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:723dabf185c5391b2edddbfd51f29a68412f5e6d87e740d09d9de77ecf341782
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:723dabf185c5391b2edddbfd51f29a68412f5e6d87e740d09d9de77ecf341782
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:723dabf185c5391b2edddbfd51f29a68412f5e6d87e740d09d9de77ecf341782].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410082026
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11ec7c20120e65236b55afd46c8c5ca2beecc2dd66df03bbfe34c904749c624d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410082026]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11ec7c20120e65236b55afd46c8c5ca2beecc2dd66df03bbfe34c904749c624d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410082026] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11ec7c20120e65236b55afd46c8c5ca2beecc2dd66df03bbfe34c904749c624d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11ec7c20120e65236b55afd46c8c5ca2beecc2dd66df03bbfe34c904749c624d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11ec7c20120e65236b55afd46c8c5ca2beecc2dd66df03bbfe34c904749c624d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:11ec7c20120e65236b55afd46c8c5ca2beecc2dd66df03bbfe34c904749c624d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1179290.
Stopping expansion service pid: 1179291.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 42s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/uxx6c3rkv4suy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1507
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1507/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410022040",
"environmentId": "gnnXcBsXkrbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-023057"
}
]
},
"name": "go-testxlang_partition-157",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/10 03:15:17 Submitted job: 2023-04-09_20_15_16-5090312774237791220
2023/04/10 03:15:17 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-09_20_15_16-5090312774237791220?project=apache-beam-testing
2023/04/10 03:15:17 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-09_20_15_16-5090312774237791220
2023/04/10 03:15:17 Job state: JOB_STATE_PENDING ...
2023/04/10 03:15:47 Job still running ...
2023/04/10 03:16:17 Job still running ...
2023/04/10 03:16:47 Job still running ...
2023/04/10 03:17:17 Job still running ...
2023/04/10 03:17:47 Job still running ...
2023/04/10 03:18:17 Job still running ...
2023/04/10 03:18:47 Job still running ...
2023/04/10 03:19:17 Job still running ...
2023/04/10 03:19:47 Job still running ...
2023/04/10 03:20:17 Job still running ...
2023/04/10 03:20:47 Job still running ...
2023/04/10 03:21:17 Job still running ...
2023/04/10 03:21:47 Job still running ...
2023/04/10 03:22:17 Job still running ...
2023/04/10 03:22:48 Job still running ...
2023/04/10 03:23:18 Job still running ...
2023/04/10 03:23:48 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-09_20_15_16-5090312774237791220 failed
--- FAIL: TestXLang_Partition (549.79s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3171.362s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681093890058130240
--- FAIL: TestBigQueryIO_BasicWriteRead (4.38s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39881 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bcVYjdAGuT" is_bounded:BOUNDED windowing_strategy_id:"w0@bcVYjdAGuT"}} windowing_strategies:{key:"w0@bcVYjdAGuT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bcVYjdAGuT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bcVYjdAGuT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bcVYjdAGuT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681093890058130240\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bcVYjdAGuT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39881 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@bcVYjdAGuT" is_bounded:BOUNDED windowing_strategy_id:"w0@bcVYjdAGuT"}} windowing_strategies:{key:"w0@bcVYjdAGuT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@bcVYjdAGuT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@bcVYjdAGuT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@bcVYjdAGuT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681093890058130240\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"bcVYjdAGuT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0004bacc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0004bacc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005a0040?, 0xc00012e000?}, {0x113d039, 0x39}, {0xc0004fe000?, 0x104b4a0?, 0xc000594060?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012e000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc000128008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.405s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.018s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-023057
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-023057
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:11ca259871ae5546f44cd5d6dcced138fdfd9ac192e0688523ea38500caf3ca6
Deleted: sha256:eccaaf22e22dcfe79f3c7b3fe978fc057cff90d041073c37bf4d649dd3920372
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-023057
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:11ca259871ae5546f44cd5d6dcced138fdfd9ac192e0688523ea38500caf3ca6
Associated tags:
- 20230410-023057
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-023057
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230410-023057].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:11ca259871ae5546f44cd5d6dcced138fdfd9ac192e0688523ea38500caf3ca6].
$ rm -rf /tmp/tmp.CgWbXQ0ecw
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:05f4ad5105b6b3e93c7b2bcf6cba3162d1e7097afa8fffe27aa26fa85429a39f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:05f4ad5105b6b3e93c7b2bcf6cba3162d1e7097afa8fffe27aa26fa85429a39f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230410022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:05f4ad5105b6b3e93c7b2bcf6cba3162d1e7097afa8fffe27aa26fa85429a39f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:05f4ad5105b6b3e93c7b2bcf6cba3162d1e7097afa8fffe27aa26fa85429a39f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:05f4ad5105b6b3e93c7b2bcf6cba3162d1e7097afa8fffe27aa26fa85429a39f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:05f4ad5105b6b3e93c7b2bcf6cba3162d1e7097afa8fffe27aa26fa85429a39f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4a13cca1d5009624b8a16cedf79d5cc9343dbf29451d62a6bb550d81f8fd5169
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4a13cca1d5009624b8a16cedf79d5cc9343dbf29451d62a6bb550d81f8fd5169]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230410022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4a13cca1d5009624b8a16cedf79d5cc9343dbf29451d62a6bb550d81f8fd5169])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4a13cca1d5009624b8a16cedf79d5cc9343dbf29451d62a6bb550d81f8fd5169
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4a13cca1d5009624b8a16cedf79d5cc9343dbf29451d62a6bb550d81f8fd5169
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4a13cca1d5009624b8a16cedf79d5cc9343dbf29451d62a6bb550d81f8fd5169].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 868537.
Stopping expansion service pid: 868538.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 3s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/nv7p6doibfqp6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1506
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1506/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409202038",
"environmentId": "MQgtkDFWgLbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-203057"
}
]
},
"name": "go-testxlang_partition-670",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/09 21:14:49 Submitted job: 2023-04-09_14_14_49-6965280644695052997
2023/04/09 21:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-09_14_14_49-6965280644695052997?project=apache-beam-testing
2023/04/09 21:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-09_14_14_49-6965280644695052997
2023/04/09 21:14:49 Job state: JOB_STATE_PENDING ...
2023/04/09 21:15:19 Job still running ...
2023/04/09 21:15:49 Job still running ...
2023/04/09 21:16:19 Job still running ...
2023/04/09 21:16:49 Job still running ...
2023/04/09 21:17:19 Job still running ...
2023/04/09 21:17:49 Job still running ...
2023/04/09 21:18:19 Job still running ...
2023/04/09 21:18:49 Job still running ...
2023/04/09 21:19:19 Job still running ...
2023/04/09 21:19:49 Job still running ...
2023/04/09 21:20:20 Job still running ...
2023/04/09 21:20:50 Job still running ...
2023/04/09 21:21:20 Job still running ...
2023/04/09 21:21:50 Job still running ...
2023/04/09 21:22:20 Job still running ...
2023/04/09 21:22:50 Job still running ...
2023/04/09 21:23:20 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-09_14_14_49-6965280644695052997 failed
--- FAIL: TestXLang_Partition (549.92s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3142.823s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681072290799375356
--- FAIL: TestBigQueryIO_BasicWriteRead (4.51s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41167 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@CcrozFawrC" is_bounded:BOUNDED windowing_strategy_id:"w0@CcrozFawrC"}} windowing_strategies:{key:"w0@CcrozFawrC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@CcrozFawrC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@CcrozFawrC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@CcrozFawrC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681072290799375356\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"CcrozFawrC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41167 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@CcrozFawrC" is_bounded:BOUNDED windowing_strategy_id:"w0@CcrozFawrC"}} windowing_strategies:{key:"w0@CcrozFawrC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@CcrozFawrC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@CcrozFawrC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@CcrozFawrC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681072290799375356\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"CcrozFawrC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0004d0900})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0004d0900})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a80a0?, 0xc0000be0a0?}, {0x113d039, 0x39}, {0xc0001560c0?, 0x104b4a0?, 0xc0000c0120?}, {0xc00049e380, 0xf}, 0xc0004ebd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a8040?, 0xc0000be0a0?}, {0xc00010e780, 0x52}, {0x1?}, {0xc0004ebea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00049e380, 0xf}, {0xc00010e780, 0x52}, {0xebdac0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003221a0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003221a0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.535s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-203057
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-203057
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f47582f6b3efd2f5485fa9468af041ca50ba53b4412e43fa86addb18cdff84f3
Deleted: sha256:2be70ff78550272d4381d75804d6e877362f11a37e57b7ee7637c3958b1cd3b3
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-203057
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f47582f6b3efd2f5485fa9468af041ca50ba53b4412e43fa86addb18cdff84f3
Associated tags:
- 20230409-203057
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-203057
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-203057].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f47582f6b3efd2f5485fa9468af041ca50ba53b4412e43fa86addb18cdff84f3].
$ rm -rf /tmp/tmp.NGs9qpn6UF
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409202038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8420191bb047d8a3cf33088b9af4cf769ddee748a239e26822e348aefc4e4db0
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409202038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8420191bb047d8a3cf33088b9af4cf769ddee748a239e26822e348aefc4e4db0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409202038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8420191bb047d8a3cf33088b9af4cf769ddee748a239e26822e348aefc4e4db0])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8420191bb047d8a3cf33088b9af4cf769ddee748a239e26822e348aefc4e4db0
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8420191bb047d8a3cf33088b9af4cf769ddee748a239e26822e348aefc4e4db0
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8420191bb047d8a3cf33088b9af4cf769ddee748a239e26822e348aefc4e4db0].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409202038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:215b5acfea6f5531703ebcaaf8a9d530b10cab5eff6df456abebf083d4c7c976
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409202038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:215b5acfea6f5531703ebcaaf8a9d530b10cab5eff6df456abebf083d4c7c976]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409202038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:215b5acfea6f5531703ebcaaf8a9d530b10cab5eff6df456abebf083d4c7c976])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:215b5acfea6f5531703ebcaaf8a9d530b10cab5eff6df456abebf083d4c7c976
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:215b5acfea6f5531703ebcaaf8a9d530b10cab5eff6df456abebf083d4c7c976
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:215b5acfea6f5531703ebcaaf8a9d530b10cab5eff6df456abebf083d4c7c976].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 513270.
Stopping expansion service pid: 513271.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 37s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/gpuddzptclqqk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1505
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1505/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409142038",
"environmentId": "URLiRRfOVCbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-143113"
}
]
},
"name": "go-testxlang_partition-744",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/09 15:14:07 Submitted job: 2023-04-09_08_14_06-6685983552931260531
2023/04/09 15:14:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-09_08_14_06-6685983552931260531?project=apache-beam-testing
2023/04/09 15:14:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-09_08_14_06-6685983552931260531
2023/04/09 15:14:07 Job state: JOB_STATE_PENDING ...
2023/04/09 15:14:37 Job still running ...
2023/04/09 15:15:07 Job still running ...
2023/04/09 15:15:37 Job still running ...
2023/04/09 15:16:08 Job still running ...
2023/04/09 15:16:38 Job still running ...
2023/04/09 15:17:08 Job still running ...
2023/04/09 15:17:38 Job still running ...
2023/04/09 15:18:08 Job still running ...
2023/04/09 15:18:38 Job still running ...
2023/04/09 15:19:08 Job still running ...
2023/04/09 15:19:38 Job still running ...
2023/04/09 15:20:08 Job still running ...
2023/04/09 15:20:38 Job still running ...
2023/04/09 15:21:08 Job still running ...
2023/04/09 15:21:38 Job still running ...
2023/04/09 15:22:08 Job still running ...
2023/04/09 15:22:38 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-09_08_14_06-6685983552931260531 failed
--- FAIL: TestXLang_Partition (550.76s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3084.581s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681050707706785003
--- FAIL: TestBigQueryIO_BasicWriteRead (4.33s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39515 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZOpxjVSgUi" is_bounded:BOUNDED windowing_strategy_id:"w0@ZOpxjVSgUi"}} windowing_strategies:{key:"w0@ZOpxjVSgUi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZOpxjVSgUi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZOpxjVSgUi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZOpxjVSgUi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681050707706785003\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZOpxjVSgUi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39515 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZOpxjVSgUi" is_bounded:BOUNDED windowing_strategy_id:"w0@ZOpxjVSgUi"}} windowing_strategies:{key:"w0@ZOpxjVSgUi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZOpxjVSgUi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZOpxjVSgUi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZOpxjVSgUi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681050707706785003\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZOpxjVSgUi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0005a2bc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0005a2bc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005a4020?, 0xc00012e000?}, {0x113d039, 0x39}, {0xc000116000?, 0x104b4a0?, 0xc00064e030?}, {0xc00047cf50, 0xf}, 0xc0000ebd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012e000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000ebea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc000128008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.359s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.023s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-143113
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-143113
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1994d793a4633eb1b7506862d77f3f55bb8dba34bc8c16867eaf8b09f1ee4506
Deleted: sha256:74f504476822772855f20f842b6951c67aef99ece2e269229f1528f3a9d84889
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-143113
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1994d793a4633eb1b7506862d77f3f55bb8dba34bc8c16867eaf8b09f1ee4506
Associated tags:
- 20230409-143113
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-143113
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-143113].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1994d793a4633eb1b7506862d77f3f55bb8dba34bc8c16867eaf8b09f1ee4506].
$ rm -rf /tmp/tmp.LptrlW2JDk
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409142038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af40c4cba59198f75ff9e08f42ecbf0235580baac5315152cc4fc1cf70294334
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af40c4cba59198f75ff9e08f42ecbf0235580baac5315152cc4fc1cf70294334]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af40c4cba59198f75ff9e08f42ecbf0235580baac5315152cc4fc1cf70294334])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af40c4cba59198f75ff9e08f42ecbf0235580baac5315152cc4fc1cf70294334
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af40c4cba59198f75ff9e08f42ecbf0235580baac5315152cc4fc1cf70294334
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:af40c4cba59198f75ff9e08f42ecbf0235580baac5315152cc4fc1cf70294334].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409142038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6096d10fc2fe2009ee8625af85fbfca5c81c913fb9ef52cfab96c7e00d4fd785
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6096d10fc2fe2009ee8625af85fbfca5c81c913fb9ef52cfab96c7e00d4fd785]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6096d10fc2fe2009ee8625af85fbfca5c81c913fb9ef52cfab96c7e00d4fd785])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6096d10fc2fe2009ee8625af85fbfca5c81c913fb9ef52cfab96c7e00d4fd785
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6096d10fc2fe2009ee8625af85fbfca5c81c913fb9ef52cfab96c7e00d4fd785
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6096d10fc2fe2009ee8625af85fbfca5c81c913fb9ef52cfab96c7e00d4fd785].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 199794.
Stopping expansion service pid: 199795.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 56s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/hufdtxbqgg4gw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1504
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1504/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-083123",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409082041",
"environmentId": "cMLOLMPkvjbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-083123"
}
]
},
"name": "go-testxlang_partition-698",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/09 09:16:16 Submitted job: 2023-04-09_02_16_16-743933533210890725
2023/04/09 09:16:16 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-09_02_16_16-743933533210890725?project=apache-beam-testing
2023/04/09 09:16:16 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-09_02_16_16-743933533210890725
2023/04/09 09:16:16 Job state: JOB_STATE_PENDING ...
2023/04/09 09:16:46 Job still running ...
2023/04/09 09:17:16 Job still running ...
2023/04/09 09:17:46 Job still running ...
2023/04/09 09:18:16 Job still running ...
2023/04/09 09:18:46 Job still running ...
2023/04/09 09:19:16 Job still running ...
2023/04/09 09:19:46 Job still running ...
2023/04/09 09:20:16 Job still running ...
2023/04/09 09:20:46 Job still running ...
2023/04/09 09:21:17 Job still running ...
2023/04/09 09:21:47 Job still running ...
2023/04/09 09:22:17 Job still running ...
2023/04/09 09:22:47 Job still running ...
2023/04/09 09:23:17 Job still running ...
2023/04/09 09:23:47 Job still running ...
2023/04/09 09:24:17 Job still running ...
2023/04/09 09:24:47 Job still running ...
2023/04/09 09:25:17 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-09_02_16_16-743933533210890725 failed
--- FAIL: TestXLang_Partition (579.69s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3233.040s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681029117610420552
--- FAIL: TestBigQueryIO_BasicWriteRead (4.35s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43023 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@voiiwTOHYr" is_bounded:BOUNDED windowing_strategy_id:"w0@voiiwTOHYr"}} windowing_strategies:{key:"w0@voiiwTOHYr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@voiiwTOHYr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@voiiwTOHYr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@voiiwTOHYr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681029117610420552\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"voiiwTOHYr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43023 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@voiiwTOHYr" is_bounded:BOUNDED windowing_strategy_id:"w0@voiiwTOHYr"}} windowing_strategies:{key:"w0@voiiwTOHYr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@voiiwTOHYr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@voiiwTOHYr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@voiiwTOHYr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681029117610420552\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"voiiwTOHYr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0004d0d00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0004d0d00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a8440?, 0xc0004ca8c0?}, {0x113d039, 0x39}, {0xc000156180?, 0x104b4a0?, 0xc0000c0a50?}, {0xc0000440a0, 0xf}, 0xc0000ddd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a83e0?, 0xc0004ca8c0?}, {0xc00004e480, 0x52}, {0x1?}, {0xc0000ddea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440a0, 0xf}, {0xc00004e480, 0x52}, {0xebdac0, 0xc0000453d0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000cc4e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000cc4e0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.376s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.023s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.020s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f1677fba2c15437ecb4b5f504d0672fc0adb3bf2cf7122f531c6f0c8955a5c53
Associated tags:
- 20230409-083123
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-083123
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-083123].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f1677fba2c15437ecb4b5f504d0672fc0adb3bf2cf7122f531c6f0c8955a5c53].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0d3efeb215047276731f27e4b6653670c3e698444b71349e321749132c50c44a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0d3efeb215047276731f27e4b6653670c3e698444b71349e321749132c50c44a])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0d3efeb215047276731f27e4b6653670c3e698444b71349e321749132c50c44a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0d3efeb215047276731f27e4b6653670c3e698444b71349e321749132c50c44a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:40d33be32efd44f0328aa7e4f859fcb418ac6c793be8bcc1ee355b78c5bc79dd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:40d33be32efd44f0328aa7e4f859fcb418ac6c793be8bcc1ee355b78c5bc79dd])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:40d33be32efd44f0328aa7e4f859fcb418ac6c793be8bcc1ee355b78c5bc79dd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:40d33be32efd44f0328aa7e4f859fcb418ac6c793be8bcc1ee355b78c5bc79dd].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 33s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/jksesqvdzlrng
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1503
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1503/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409022037",
"environmentId": "iCsecSwIvGbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-023052"
}
]
},
"name": "go-testxlang_partition-767",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/09 03:15:55 Submitted job: 2023-04-08_20_15_54-756849915061403461
2023/04/09 03:15:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-08_20_15_54-756849915061403461?project=apache-beam-testing
2023/04/09 03:15:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-08_20_15_54-756849915061403461
2023/04/09 03:15:55 Job state: JOB_STATE_PENDING ...
2023/04/09 03:16:25 Job still running ...
2023/04/09 03:16:55 Job still running ...
2023/04/09 03:17:25 Job still running ...
2023/04/09 03:17:55 Job still running ...
2023/04/09 03:18:25 Job still running ...
2023/04/09 03:18:55 Job still running ...
2023/04/09 03:19:25 Job still running ...
2023/04/09 03:19:55 Job still running ...
2023/04/09 03:20:25 Job still running ...
2023/04/09 03:20:55 Job still running ...
2023/04/09 03:21:25 Job still running ...
2023/04/09 03:21:55 Job still running ...
2023/04/09 03:22:25 Job still running ...
2023/04/09 03:22:55 Job still running ...
2023/04/09 03:23:25 Job still running ...
2023/04/09 03:23:55 Job still running ...
2023/04/09 03:24:25 Job still running ...
2023/04/09 03:24:55 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-08_20_15_54-756849915061403461 failed
--- FAIL: TestXLang_Partition (579.90s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3233.067s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681007496082371087
--- FAIL: TestBigQueryIO_BasicWriteRead (4.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZTfnQUatTV" is_bounded:BOUNDED windowing_strategy_id:"w0@ZTfnQUatTV"}} windowing_strategies:{key:"w0@ZTfnQUatTV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZTfnQUatTV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZTfnQUatTV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZTfnQUatTV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681007496082371087\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZTfnQUatTV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZTfnQUatTV" is_bounded:BOUNDED windowing_strategy_id:"w0@ZTfnQUatTV"}} windowing_strategies:{key:"w0@ZTfnQUatTV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZTfnQUatTV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZTfnQUatTV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZTfnQUatTV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1681007496082371087\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZTfnQUatTV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 39 [running]:
testing.tRunner.func1.2({0xf70500, 0xc00015b840})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc00015b840})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004a40e0?, 0xc000134230?}, {0x113d039, 0x39}, {0xc000018000?, 0x104b4a0?, 0xc0004ce0f0?}, {0xc0000440a0, 0xf}, 0xc00051bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004a4020?, 0xc000134230?}, {0xc00004e480, 0x52}, {0x1?}, {0xc00051bea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440a0, 0xf}, {0xc00004e480, 0x52}, {0xebdac0, 0xc00049e388})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005029c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005029c0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.461s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.019s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-023052
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-023052
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7659fd5fe7b2951b5eaf5c09f44481c027caed1704a2c2031d0f1c30e10ef094
Deleted: sha256:3fe324eeba04635e45bc02d17d63305648ec6aa9d20fce9c3d2ae7814a722297
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-023052
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7659fd5fe7b2951b5eaf5c09f44481c027caed1704a2c2031d0f1c30e10ef094
Associated tags:
- 20230409-023052
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-023052
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230409-023052].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7659fd5fe7b2951b5eaf5c09f44481c027caed1704a2c2031d0f1c30e10ef094].
$ rm -rf /tmp/tmp.NkR43SeXPQ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409022037
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:47dfc4258eed5c7a954476451ebdde171804a0b38dd40773330082b9a2d48057
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409022037]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:47dfc4258eed5c7a954476451ebdde171804a0b38dd40773330082b9a2d48057]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230409022037] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:47dfc4258eed5c7a954476451ebdde171804a0b38dd40773330082b9a2d48057])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:47dfc4258eed5c7a954476451ebdde171804a0b38dd40773330082b9a2d48057
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:47dfc4258eed5c7a954476451ebdde171804a0b38dd40773330082b9a2d48057
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:47dfc4258eed5c7a954476451ebdde171804a0b38dd40773330082b9a2d48057].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409022037
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bedcd2724325dea7adfe2c79a6ad2774a3b9379606ebfadf31a4a63217ba5b64
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409022037]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bedcd2724325dea7adfe2c79a6ad2774a3b9379606ebfadf31a4a63217ba5b64]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409022037] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bedcd2724325dea7adfe2c79a6ad2774a3b9379606ebfadf31a4a63217ba5b64])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bedcd2724325dea7adfe2c79a6ad2774a3b9379606ebfadf31a4a63217ba5b64
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bedcd2724325dea7adfe2c79a6ad2774a3b9379606ebfadf31a4a63217ba5b64
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bedcd2724325dea7adfe2c79a6ad2774a3b9379606ebfadf31a4a63217ba5b64].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3948251.
Stopping expansion service pid: 3948252.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 13s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/mofy43d74mfjo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1502
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1502/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408202045",
"environmentId": "qQISPPPGPxbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-203054"
}
]
},
"name": "go-testxlang_partition-967",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/08 21:15:18 Submitted job: 2023-04-08_14_15_17-4845815707579582525
2023/04/08 21:15:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-08_14_15_17-4845815707579582525?project=apache-beam-testing
2023/04/08 21:15:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-08_14_15_17-4845815707579582525
2023/04/08 21:15:18 Job state: JOB_STATE_PENDING ...
2023/04/08 21:15:48 Job still running ...
2023/04/08 21:16:18 Job still running ...
2023/04/08 21:16:48 Job still running ...
2023/04/08 21:17:18 Job still running ...
2023/04/08 21:17:48 Job still running ...
2023/04/08 21:18:18 Job still running ...
2023/04/08 21:18:48 Job still running ...
2023/04/08 21:19:18 Job still running ...
2023/04/08 21:19:48 Job still running ...
2023/04/08 21:20:18 Job still running ...
2023/04/08 21:20:48 Job still running ...
2023/04/08 21:21:18 Job still running ...
2023/04/08 21:21:48 Job still running ...
2023/04/08 21:22:18 Job still running ...
2023/04/08 21:22:48 Job still running ...
2023/04/08 21:23:18 Job still running ...
2023/04/08 21:23:48 Job still running ...
2023/04/08 21:24:18 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-08_14_15_17-4845815707579582525 failed
--- FAIL: TestXLang_Partition (580.08s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3202.924s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680985889347871060
--- FAIL: TestBigQueryIO_BasicWriteRead (4.34s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40929 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@yVwWCjndJd" is_bounded:BOUNDED windowing_strategy_id:"w0@yVwWCjndJd"}} windowing_strategies:{key:"w0@yVwWCjndJd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@yVwWCjndJd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@yVwWCjndJd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@yVwWCjndJd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680985889347871060\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"yVwWCjndJd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40929 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@yVwWCjndJd" is_bounded:BOUNDED windowing_strategy_id:"w0@yVwWCjndJd"}} windowing_strategies:{key:"w0@yVwWCjndJd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@yVwWCjndJd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@yVwWCjndJd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@yVwWCjndJd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680985889347871060\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"yVwWCjndJd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0000b3180})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0000b3180})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00048f680?, 0xc0004b4960?}, {0x113d039, 0x39}, {0xc0000f20c0?, 0x104b4a0?, 0xc0004b8d50?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00048f620?, 0xc0004b4960?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc0004f0270})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.358s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-203054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-203054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4b000442dff69eddc784c24757827bc1938088bfbe5eb8e956f51b25f898e729
Deleted: sha256:27b9db334e1fa007cf0d01850a303b2b761751501a265e8b85dd1f8cce3a7276
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-203054
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4b000442dff69eddc784c24757827bc1938088bfbe5eb8e956f51b25f898e729
Associated tags:
- 20230408-203054
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-203054
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-203054].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4b000442dff69eddc784c24757827bc1938088bfbe5eb8e956f51b25f898e729].
$ rm -rf /tmp/tmp.i4pQ2dg8jm
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408202045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53860f67559788febc0598a201c68f246231c68552aa8c69821a558f98c3caeb
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408202045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53860f67559788febc0598a201c68f246231c68552aa8c69821a558f98c3caeb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408202045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53860f67559788febc0598a201c68f246231c68552aa8c69821a558f98c3caeb])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53860f67559788febc0598a201c68f246231c68552aa8c69821a558f98c3caeb
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53860f67559788febc0598a201c68f246231c68552aa8c69821a558f98c3caeb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:53860f67559788febc0598a201c68f246231c68552aa8c69821a558f98c3caeb].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408202045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c41c5105f1b1f3fb233cb5de0ccc29c0259c70ff0625f1326282344e09b19ea
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408202045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c41c5105f1b1f3fb233cb5de0ccc29c0259c70ff0625f1326282344e09b19ea]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408202045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c41c5105f1b1f3fb233cb5de0ccc29c0259c70ff0625f1326282344e09b19ea])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c41c5105f1b1f3fb233cb5de0ccc29c0259c70ff0625f1326282344e09b19ea
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c41c5105f1b1f3fb233cb5de0ccc29c0259c70ff0625f1326282344e09b19ea
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0c41c5105f1b1f3fb233cb5de0ccc29c0259c70ff0625f1326282344e09b19ea].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3633794.
Stopping expansion service pid: 3633795.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 30s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/4zi74tfrz5ct4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1501
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1501/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #26096: Allow to set operator chaining for flink
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-143116",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408142039",
"environmentId": "QgWiIitEswbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-143116"
}
]
},
"name": "go-testxlang_partition-560",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/08 15:15:14 Submitted job: 2023-04-08_08_15_14-13947352068332817830
2023/04/08 15:15:14 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-08_08_15_14-13947352068332817830?project=apache-beam-testing
2023/04/08 15:15:14 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-08_08_15_14-13947352068332817830
2023/04/08 15:15:14 Job state: JOB_STATE_PENDING ...
2023/04/08 15:15:44 Job still running ...
2023/04/08 15:16:14 Job still running ...
2023/04/08 15:16:45 Job still running ...
2023/04/08 15:17:15 Job still running ...
2023/04/08 15:17:45 Job still running ...
2023/04/08 15:18:15 Job still running ...
2023/04/08 15:18:45 Job still running ...
2023/04/08 15:19:15 Job still running ...
2023/04/08 15:19:45 Job still running ...
2023/04/08 15:20:15 Job still running ...
2023/04/08 15:20:45 Job still running ...
2023/04/08 15:21:15 Job still running ...
2023/04/08 15:21:45 Job still running ...
2023/04/08 15:22:15 Job still running ...
2023/04/08 15:22:45 Job still running ...
2023/04/08 15:23:15 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-08_08_15_14-13947352068332817830 failed
--- FAIL: TestXLang_Partition (520.79s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3115.068s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680964313789783263
--- FAIL: TestBigQueryIO_BasicWriteRead (4.62s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42431 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@VcBPCxZGMk" is_bounded:BOUNDED windowing_strategy_id:"w0@VcBPCxZGMk"}} windowing_strategies:{key:"w0@VcBPCxZGMk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@VcBPCxZGMk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@VcBPCxZGMk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@VcBPCxZGMk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680964313789783263\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"VcBPCxZGMk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42431 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@VcBPCxZGMk" is_bounded:BOUNDED windowing_strategy_id:"w0@VcBPCxZGMk"}} windowing_strategies:{key:"w0@VcBPCxZGMk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@VcBPCxZGMk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@VcBPCxZGMk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@VcBPCxZGMk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680964313789783263\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"VcBPCxZGMk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 66 [running]:
testing.tRunner.func1.2({0xf70500, 0xc00015ac00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc00015ac00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a8440?, 0xc0004ca8c0?}, {0x113d039, 0x39}, {0xc000156180?, 0x104b4a0?, 0xc0004ceae0?}, {0xc0000440a0, 0xf}, 0xc00001bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a83e0?, 0xc0004ca8c0?}, {0xc00010e7e0, 0x52}, {0x1?}, {0xc00001bea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440a0, 0xf}, {0xc00010e7e0, 0x52}, {0xebdac0, 0xc0000453d0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000007ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000007ba0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.644s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.020s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:75649b7abf6246a16c8337843c31d1cf19c97b81abb27592e8c87d3c73988fe1
Associated tags:
- 20230408-143116
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-143116
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-143116].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:75649b7abf6246a16c8337843c31d1cf19c97b81abb27592e8c87d3c73988fe1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:eb05aed50ae2021985507e1d90a22e6b2b2e79c9d07e2489ec485db33d0b5503]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:eb05aed50ae2021985507e1d90a22e6b2b2e79c9d07e2489ec485db33d0b5503])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:eb05aed50ae2021985507e1d90a22e6b2b2e79c9d07e2489ec485db33d0b5503
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:eb05aed50ae2021985507e1d90a22e6b2b2e79c9d07e2489ec485db33d0b5503].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f7b509801b3de3c636c31d31927bdd99384b3655d0ac77897e06c77f2fbf00c1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f7b509801b3de3c636c31d31927bdd99384b3655d0ac77897e06c77f2fbf00c1])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f7b509801b3de3c636c31d31927bdd99384b3655d0ac77897e06c77f2fbf00c1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f7b509801b3de3c636c31d31927bdd99384b3655d0ac77897e06c77f2fbf00c1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m 32s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/eblkmzruhrbko
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1500
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1500/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408082039",
"environmentId": "LxLhqDNghWbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-083134"
}
]
},
"name": "go-testxlang_partition-50",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/08 09:17:05 Submitted job: 2023-04-08_02_17_04-4179445263120958901
2023/04/08 09:17:05 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-08_02_17_04-4179445263120958901?project=apache-beam-testing
2023/04/08 09:17:05 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-08_02_17_04-4179445263120958901
2023/04/08 09:17:05 Job state: JOB_STATE_PENDING ...
2023/04/08 09:17:35 Job still running ...
2023/04/08 09:18:05 Job still running ...
2023/04/08 09:18:35 Job still running ...
2023/04/08 09:19:05 Job still running ...
2023/04/08 09:19:35 Job still running ...
2023/04/08 09:20:05 Job still running ...
2023/04/08 09:20:35 Job still running ...
2023/04/08 09:21:05 Job still running ...
2023/04/08 09:21:35 Job still running ...
2023/04/08 09:22:05 Job still running ...
2023/04/08 09:22:36 Job still running ...
2023/04/08 09:23:07 Job still running ...
2023/04/08 09:23:37 Job still running ...
2023/04/08 09:24:07 Job still running ...
2023/04/08 09:24:37 Job still running ...
2023/04/08 09:25:07 Job still running ...
2023/04/08 09:25:37 Job still running ...
2023/04/08 09:26:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-08_02_17_04-4179445263120958901 failed
--- FAIL: TestXLang_Partition (581.62s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3270.291s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680942730402286241
--- FAIL: TestBigQueryIO_BasicWriteRead (4.63s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43929 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QGPpjZhzLE" is_bounded:BOUNDED windowing_strategy_id:"w0@QGPpjZhzLE"}} windowing_strategies:{key:"w0@QGPpjZhzLE" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QGPpjZhzLE" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QGPpjZhzLE" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QGPpjZhzLE" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680942730402286241\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QGPpjZhzLE"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43929 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QGPpjZhzLE" is_bounded:BOUNDED windowing_strategy_id:"w0@QGPpjZhzLE"}} windowing_strategies:{key:"w0@QGPpjZhzLE" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QGPpjZhzLE" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QGPpjZhzLE" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QGPpjZhzLE" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680942730402286241\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QGPpjZhzLE"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 40 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0000b2480})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0000b2480})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004a40e0?, 0xc0004ca410?}, {0x113d039, 0x39}, {0xc0000ea000?, 0x104b4a0?, 0xc0004ce0f0?}, {0xc0000440a0, 0xf}, 0xc000521d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004a4020?, 0xc0004ca410?}, {0xc00004e480, 0x52}, {0x1?}, {0xc000521ea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440a0, 0xf}, {0xc00004e480, 0x52}, {0xebdac0, 0xc00049e388})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000502ea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000502ea0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.660s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.026s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-083134
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-083134
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6fa6691ced84b5ceb387d2e2830f5520a4b6d57638873446e3522821d1d0076d
Deleted: sha256:4987d8acdf08b3e60e9d3f567350996f3e5a3b66eb43e7189c2c038a58f93656
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-083134
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6fa6691ced84b5ceb387d2e2830f5520a4b6d57638873446e3522821d1d0076d
Associated tags:
- 20230408-083134
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-083134
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-083134].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6fa6691ced84b5ceb387d2e2830f5520a4b6d57638873446e3522821d1d0076d].
$ rm -rf /tmp/tmp.OdhV1hrrVk
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408082039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:82306ce326eaae609c28b9cf407f6fdc3599684314b7c9b9a942d8c6a210e9d2
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408082039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:82306ce326eaae609c28b9cf407f6fdc3599684314b7c9b9a942d8c6a210e9d2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408082039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:82306ce326eaae609c28b9cf407f6fdc3599684314b7c9b9a942d8c6a210e9d2])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:82306ce326eaae609c28b9cf407f6fdc3599684314b7c9b9a942d8c6a210e9d2
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:82306ce326eaae609c28b9cf407f6fdc3599684314b7c9b9a942d8c6a210e9d2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:82306ce326eaae609c28b9cf407f6fdc3599684314b7c9b9a942d8c6a210e9d2].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408082039
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:853458149045198180d9266df5be69657bffcded51e2c10b0dde97a9c8bbc0ac
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408082039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:853458149045198180d9266df5be69657bffcded51e2c10b0dde97a9c8bbc0ac]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408082039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:853458149045198180d9266df5be69657bffcded51e2c10b0dde97a9c8bbc0ac])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:853458149045198180d9266df5be69657bffcded51e2c10b0dde97a9c8bbc0ac
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:853458149045198180d9266df5be69657bffcded51e2c10b0dde97a9c8bbc0ac
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:853458149045198180d9266df5be69657bffcded51e2c10b0dde97a9c8bbc0ac].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3189578.
Stopping expansion service pid: 3189579.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 26s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/2j6unotmcjxk6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1499
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1499/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-023139",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408022029",
"environmentId": "HDQuEmBaLBbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-023139"
}
]
},
"name": "go-testxlang_partition-625",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/08 03:19:08 Submitted job: 2023-04-07_20_19_08-10951990967631380316
2023/04/08 03:19:08 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-07_20_19_08-10951990967631380316?project=apache-beam-testing
2023/04/08 03:19:08 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-07_20_19_08-10951990967631380316
2023/04/08 03:19:08 Job state: JOB_STATE_PENDING ...
2023/04/08 03:19:38 Job still running ...
2023/04/08 03:20:09 Job still running ...
2023/04/08 03:20:39 Job still running ...
2023/04/08 03:21:09 Job still running ...
2023/04/08 03:21:39 Job still running ...
2023/04/08 03:22:09 Job still running ...
2023/04/08 03:22:39 Job still running ...
2023/04/08 03:23:09 Job still running ...
2023/04/08 03:23:39 Job still running ...
2023/04/08 03:24:09 Job still running ...
2023/04/08 03:24:39 Job still running ...
2023/04/08 03:25:09 Job still running ...
2023/04/08 03:25:39 Job still running ...
2023/04/08 03:26:09 Job still running ...
2023/04/08 03:26:39 Job still running ...
2023/04/08 03:27:09 Job still running ...
2023/04/08 03:27:39 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-07_20_19_08-10951990967631380316 failed
--- FAIL: TestXLang_Partition (550.50s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3356.723s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680921136569995510
--- FAIL: TestBigQueryIO_BasicWriteRead (4.82s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40911 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@auyYHtQPie" is_bounded:BOUNDED windowing_strategy_id:"w0@auyYHtQPie"}} windowing_strategies:{key:"w0@auyYHtQPie" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@auyYHtQPie" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@auyYHtQPie" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@auyYHtQPie" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680921136569995510\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"auyYHtQPie"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40911 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@auyYHtQPie" is_bounded:BOUNDED windowing_strategy_id:"w0@auyYHtQPie"}} windowing_strategies:{key:"w0@auyYHtQPie" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@auyYHtQPie" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@auyYHtQPie" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@auyYHtQPie" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680921136569995510\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"auyYHtQPie"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0006e0fc0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0006e0fc0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00048f680?, 0xc0004b4960?}, {0x113d039, 0x39}, {0xc0000f20c0?, 0x104b4a0?, 0xc0004b8d50?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00048f620?, 0xc0004b4960?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc0004f0270})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.846s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.027s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c51b9d27b449f1d9f134517d254b34fff9253ffe147ae576c3afbf539a573229
Associated tags:
- 20230408-023139
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-023139
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230408-023139].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c51b9d27b449f1d9f134517d254b34fff9253ffe147ae576c3afbf539a573229].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408022029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d926cb6819ede64fc9aacc7945933a340c7d09be3bc22b7d4609d47c30023bf8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230408022029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d926cb6819ede64fc9aacc7945933a340c7d09be3bc22b7d4609d47c30023bf8])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d926cb6819ede64fc9aacc7945933a340c7d09be3bc22b7d4609d47c30023bf8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d926cb6819ede64fc9aacc7945933a340c7d09be3bc22b7d4609d47c30023bf8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408022029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c351b5e47d44e0bd0f04b45c10def7d37d6fbf0d9af41c9ff3f5036437a4a82a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230408022029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c351b5e47d44e0bd0f04b45c10def7d37d6fbf0d9af41c9ff3f5036437a4a82a])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c351b5e47d44e0bd0f04b45c10def7d37d6fbf0d9af41c9ff3f5036437a4a82a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c351b5e47d44e0bd0f04b45c10def7d37d6fbf0d9af41c9ff3f5036437a4a82a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 9s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ibtjjg6si4n2e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1498
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1498/display/redirect?page=changes>
Changes:
[noreply] Move automatic model refresh notebook to correct dir (#26176)
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-203820",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230407202052",
"environmentId": "UAxdckGWAsbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-203820"
}
]
},
"name": "go-testxlang_partition-17",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/07 21:22:56 Submitted job: 2023-04-07_14_22_55-15389883758113123834
2023/04/07 21:22:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-07_14_22_55-15389883758113123834?project=apache-beam-testing
2023/04/07 21:22:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-07_14_22_55-15389883758113123834
2023/04/07 21:22:56 Job state: JOB_STATE_PENDING ...
2023/04/07 21:23:26 Job still running ...
2023/04/07 21:23:56 Job still running ...
2023/04/07 21:24:26 Job still running ...
2023/04/07 21:24:56 Job still running ...
2023/04/07 21:25:26 Job still running ...
2023/04/07 21:25:56 Job still running ...
2023/04/07 21:26:26 Job still running ...
2023/04/07 21:26:56 Job still running ...
2023/04/07 21:27:26 Job still running ...
2023/04/07 21:27:57 Job still running ...
2023/04/07 21:28:27 Job still running ...
2023/04/07 21:28:57 Job still running ...
2023/04/07 21:29:27 Job still running ...
2023/04/07 21:29:57 Job still running ...
2023/04/07 21:30:27 Job still running ...
2023/04/07 21:30:57 Job still running ...
2023/04/07 21:31:27 Job still running ...
2023/04/07 21:31:57 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-07_14_22_55-15389883758113123834 failed
--- FAIL: TestXLang_Partition (580.96s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3211.846s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680899940129848727
--- FAIL: TestBigQueryIO_BasicWriteRead (6.14s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41271 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lhAPoreSOo" is_bounded:BOUNDED windowing_strategy_id:"w0@lhAPoreSOo"}} windowing_strategies:{key:"w0@lhAPoreSOo" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lhAPoreSOo" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lhAPoreSOo" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lhAPoreSOo" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680899940129848727\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lhAPoreSOo"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41271 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@lhAPoreSOo" is_bounded:BOUNDED windowing_strategy_id:"w0@lhAPoreSOo"}} windowing_strategies:{key:"w0@lhAPoreSOo" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@lhAPoreSOo" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@lhAPoreSOo" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@lhAPoreSOo" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680899940129848727\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"lhAPoreSOo"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0004946c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0004946c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005240e0?, 0xc000180280?}, {0x113d039, 0x39}, {0xc00013a000?, 0x104b4a0?, 0xc0001160f0?}, {0xc0000440d0, 0xf}, 0xc0000d5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000524020?, 0xc000180280?}, {0xc00004e480, 0x52}, {0x1?}, {0xc0000d5ea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000440d0, 0xf}, {0xc00004e480, 0x52}, {0xebdac0, 0xc00051e388})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006424e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006424e0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.168s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.028s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:60a2adc0a17b54559141fbbc559eeb9c169809af767aabf6ac239b922634532a
Associated tags:
- 20230407-203820
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-203820
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-203820].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:60a2adc0a17b54559141fbbc559eeb9c169809af767aabf6ac239b922634532a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230407202052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7309ea60b9e70cc89f3e5fd7328a8428f29ea7123c867c4d6d52e83d340b990e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230407202052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7309ea60b9e70cc89f3e5fd7328a8428f29ea7123c867c4d6d52e83d340b990e])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7309ea60b9e70cc89f3e5fd7328a8428f29ea7123c867c4d6d52e83d340b990e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7309ea60b9e70cc89f3e5fd7328a8428f29ea7123c867c4d6d52e83d340b990e].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230407202052]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:67466a7247f76cb0182f020b1fbc26ff96e6df561d66b13d638a964bec072df2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230407202052] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:67466a7247f76cb0182f020b1fbc26ff96e6df561d66b13d638a964bec072df2])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:67466a7247f76cb0182f020b1fbc26ff96e6df561d66b13d638a964bec072df2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:67466a7247f76cb0182f020b1fbc26ff96e6df561d66b13d638a964bec072df2].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 12m 8s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/4ixtpd5oiwjos
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1496
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1496/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-12 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 77b7b4ef82416683377bfa8bd09239ce002d7246 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 77b7b4ef82416683377bfa8bd09239ce002d7246 # timeout=10
Commit message: "Use wheels for Dataflow postcommit tests (#25970)"
> git rev-list --no-walk 77b7b4ef82416683377bfa8bd09239ce002d7246 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_GoUsingJava_Dataflow] $ /bin/bash -xe /tmp/jenkins5020886924146519410.sh
+ echo '*** RUN CROSS-LANGUAGE DATAFLOW GO WITH JAVA EXTERNAL TRANSFORMS ***'
*** RUN CROSS-LANGUAGE DATAFLOW GO WITH JAVA EXTERNAL TRANSFORMS ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava
To honour the JVM settings for this build a single-use Daemon process will be forked. See https://docs.gradle.org/7.5.1/userguide/gradle_daemon.html#sec:disabling_the_daemon.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy FROM-CACHE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle FROM-CACHE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins FROM-CACHE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.20.2
go1.20.2: already downloaded in /home/jenkins/sdk/go1.20.2
GOCMD=/home/jenkins/go/bin/go1.20.2
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.20.2
go1.20.2: already downloaded in /home/jenkins/sdk/go1.20.2
GOCMD=/home/jenkins/go/bin/go1.20.2
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:java:testing:expansion-service:buildTestExpansionServiceJar'.
> Could not resolve all dependencies for configuration ':sdks:java:testing:expansion-service:testRuntimeClasspath'.
> Could not resolve net.minidev:json-smart:[1.3.1,2.3].
Required by:
project :sdks:java:testing:expansion-service > project :sdks:java:io:parquet > org.apache.hadoop:hadoop-common:2.10.2 > org.apache.hadoop:hadoop-auth:2.10.2 > com.nimbusds:nimbus-jose-jwt:7.9
> Failed to list versions for net.minidev:json-smart.
> Unable to load Maven meta-data from https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/maven-metadata.xml.
> Could not HEAD 'https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/maven-metadata.xml'. Received status code 504 from server: Gateway Time-out
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 53s
10 actionable tasks: 4 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/f76aqxbz7t224
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1495
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1495/display/redirect>
Changes:
------------------------------------------
[...truncated 1.08 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230407022041",
"environmentId": "sfDBUMXDdJbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-023132"
}
]
},
"name": "go-testxlang_partition-914",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/07 03:19:04 Submitted job: 2023-04-06_20_19_04-10960940030405871417
2023/04/07 03:19:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-06_20_19_04-10960940030405871417?project=apache-beam-testing
2023/04/07 03:19:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-06_20_19_04-10960940030405871417
2023/04/07 03:19:04 Job state: JOB_STATE_PENDING ...
2023/04/07 03:19:34 Job still running ...
2023/04/07 03:20:04 Job still running ...
2023/04/07 03:20:34 Job still running ...
2023/04/07 03:21:04 Job still running ...
2023/04/07 03:21:34 Job still running ...
2023/04/07 03:22:04 Job still running ...
2023/04/07 03:22:34 Job still running ...
2023/04/07 03:23:04 Job still running ...
2023/04/07 03:23:35 Job still running ...
2023/04/07 03:24:05 Job still running ...
2023/04/07 03:24:35 Job still running ...
2023/04/07 03:25:05 Job still running ...
2023/04/07 03:25:35 Job still running ...
2023/04/07 03:26:05 Job still running ...
2023/04/07 03:26:35 Job still running ...
2023/04/07 03:27:08 Job still running ...
2023/04/07 03:27:38 Job still running ...
2023/04/07 03:28:08 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-06_20_19_04-10960940030405871417 failed
--- FAIL: TestXLang_Partition (583.22s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3390.348s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680834733124828339
--- FAIL: TestBigQueryIO_BasicWriteRead (5.10s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44847 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FKIEEbRAJw" is_bounded:BOUNDED windowing_strategy_id:"w0@FKIEEbRAJw"}} windowing_strategies:{key:"w0@FKIEEbRAJw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FKIEEbRAJw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FKIEEbRAJw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FKIEEbRAJw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680834733124828339\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FKIEEbRAJw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44847 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FKIEEbRAJw" is_bounded:BOUNDED windowing_strategy_id:"w0@FKIEEbRAJw"}} windowing_strategies:{key:"w0@FKIEEbRAJw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FKIEEbRAJw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FKIEEbRAJw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FKIEEbRAJw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680834733124828339\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FKIEEbRAJw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0002f0700})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0002f0700})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00048f680?, 0xc0004b4960?}, {0x113d039, 0x39}, {0xc0000f20c0?, 0x104b4a0?, 0xc0004b8d50?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00048f620?, 0xc0004b4960?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc0004f0270})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.123s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.038s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-023132
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-023132
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:633aabeb444663967c1878fc13d3d94782739e9f754077a3a89406b407bfdec6
Deleted: sha256:53e4f630b58a0db49169c073cd273ffae52487741c7fe7475412fad823156faf
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-023132
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:633aabeb444663967c1878fc13d3d94782739e9f754077a3a89406b407bfdec6
Associated tags:
- 20230407-023132
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-023132
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230407-023132].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:633aabeb444663967c1878fc13d3d94782739e9f754077a3a89406b407bfdec6].
$ rm -rf /tmp/tmp.umb6KgBvoH
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230407022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34100e66f582696ea7d29b99799a12229bb8b8e10d877e8156ff9afa9106b912
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230407022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34100e66f582696ea7d29b99799a12229bb8b8e10d877e8156ff9afa9106b912]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230407022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34100e66f582696ea7d29b99799a12229bb8b8e10d877e8156ff9afa9106b912])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34100e66f582696ea7d29b99799a12229bb8b8e10d877e8156ff9afa9106b912
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34100e66f582696ea7d29b99799a12229bb8b8e10d877e8156ff9afa9106b912
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:34100e66f582696ea7d29b99799a12229bb8b8e10d877e8156ff9afa9106b912].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230407022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9072e95e61f555107106da8eccf58a4c59aa44f93135e7d36bd23416159fd63
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230407022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9072e95e61f555107106da8eccf58a4c59aa44f93135e7d36bd23416159fd63]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230407022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9072e95e61f555107106da8eccf58a4c59aa44f93135e7d36bd23416159fd63])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9072e95e61f555107106da8eccf58a4c59aa44f93135e7d36bd23416159fd63
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9072e95e61f555107106da8eccf58a4c59aa44f93135e7d36bd23416159fd63
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a9072e95e61f555107106da8eccf58a4c59aa44f93135e7d36bd23416159fd63].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1779424.
Stopping expansion service pid: 1779425.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 24s
232 actionable tasks: 153 executed, 67 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/locejcafrpixc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1494
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1494/display/redirect>
Changes:
------------------------------------------
[...truncated 1.07 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-210046",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406204631",
"environmentId": "oPXwxclNVUbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-210046"
}
]
},
"name": "go-testxlang_partition-971",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/06 21:49:47 Submitted job: 2023-04-06_14_49_46-6155857836323534936
2023/04/06 21:49:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-06_14_49_46-6155857836323534936?project=apache-beam-testing
2023/04/06 21:49:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-06_14_49_46-6155857836323534936
2023/04/06 21:49:47 Job state: JOB_STATE_PENDING ...
2023/04/06 21:50:17 Job still running ...
2023/04/06 21:50:47 Job still running ...
2023/04/06 21:51:17 Job still running ...
2023/04/06 21:51:47 Job still running ...
2023/04/06 21:52:17 Job still running ...
2023/04/06 21:52:48 Job still running ...
2023/04/06 21:53:18 Job still running ...
2023/04/06 21:53:48 Job still running ...
2023/04/06 21:54:18 Job still running ...
2023/04/06 21:54:48 Job still running ...
2023/04/06 21:55:18 Job still running ...
2023/04/06 21:55:48 Job still running ...
2023/04/06 21:56:18 Job still running ...
2023/04/06 21:56:48 Job still running ...
2023/04/06 21:57:18 Job still running ...
2023/04/06 21:57:48 Job still running ...
2023/04/06 21:58:18 Job still running ...
2023/04/06 21:58:48 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-06_14_49_46-6155857836323534936 failed
--- FAIL: TestXLang_Partition (583.98s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3469.134s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680814898524984132
--- FAIL: TestBigQueryIO_BasicWriteRead (6.37s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33891 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uldLWWQVkL" is_bounded:BOUNDED windowing_strategy_id:"w0@uldLWWQVkL"}} windowing_strategies:{key:"w0@uldLWWQVkL" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uldLWWQVkL" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uldLWWQVkL" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uldLWWQVkL" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680814898524984132\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uldLWWQVkL"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33891 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@uldLWWQVkL" is_bounded:BOUNDED windowing_strategy_id:"w0@uldLWWQVkL"}} windowing_strategies:{key:"w0@uldLWWQVkL" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@uldLWWQVkL" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@uldLWWQVkL" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@uldLWWQVkL" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680814898524984132\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"uldLWWQVkL"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 11 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0006f6c40})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0006f6c40})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001e01c0?, 0xc000168000?}, {0x113d039, 0x39}, {0xc0001ce0c0?, 0x104b4a0?, 0xc0006960c0?}, {0xc000155350, 0xf}, 0xc00001bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0001e00a0?, 0xc000168000?}, {0xc00004e600, 0x52}, {0x1?}, {0xc00001bea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000155350, 0xf}, {0xc00004e600, 0x52}, {0xebdac0, 0xc0001a4078})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005011e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005011e0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 9.394s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.030s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.029s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b1ba45286302d6910c1e8f72454a7f0f66e02bf50d32caa6883a1328749d7e48
Associated tags:
- 20230406-210046
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-210046
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-210046].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b1ba45286302d6910c1e8f72454a7f0f66e02bf50d32caa6883a1328749d7e48].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406204631]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e4ab6f0f84c6551e2f73258c399b9bfbfee826e37d5111f5e8c635eab0a5a38c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406204631] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e4ab6f0f84c6551e2f73258c399b9bfbfee826e37d5111f5e8c635eab0a5a38c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e4ab6f0f84c6551e2f73258c399b9bfbfee826e37d5111f5e8c635eab0a5a38c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e4ab6f0f84c6551e2f73258c399b9bfbfee826e37d5111f5e8c635eab0a5a38c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406204631]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ca94e8057adf1a9e8b58e3b9d51e5480fa39b0f106353215cd9afe4be732d7c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406204631] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ca94e8057adf1a9e8b58e3b9d51e5480fa39b0f106353215cd9afe4be732d7c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ca94e8057adf1a9e8b58e3b9d51e5480fa39b0f106353215cd9afe4be732d7c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ca94e8057adf1a9e8b58e3b9d51e5480fa39b0f106353215cd9afe4be732d7c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 13m 32s
232 actionable tasks: 164 executed, 57 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/hogdqwmo3iypi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1493
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1493/display/redirect>
Changes:
------------------------------------------
[...truncated 1.07 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-143133",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406142044",
"environmentId": "QHuevmfYNwbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-143133"
}
]
},
"name": "go-testxlang_partition-246",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/06 15:18:51 Submitted job: 2023-04-06_08_18_51-17396477248356965219
2023/04/06 15:18:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-06_08_18_51-17396477248356965219?project=apache-beam-testing
2023/04/06 15:18:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-06_08_18_51-17396477248356965219
2023/04/06 15:18:51 Job state: JOB_STATE_PENDING ...
2023/04/06 15:19:21 Job still running ...
2023/04/06 15:19:51 Job still running ...
2023/04/06 15:20:22 Job still running ...
2023/04/06 15:20:52 Job still running ...
2023/04/06 15:21:22 Job still running ...
2023/04/06 15:21:52 Job still running ...
2023/04/06 15:22:22 Job still running ...
2023/04/06 15:22:52 Job still running ...
2023/04/06 15:23:22 Job still running ...
2023/04/06 15:23:52 Job still running ...
2023/04/06 15:24:22 Job still running ...
2023/04/06 15:24:52 Job still running ...
2023/04/06 15:25:22 Job still running ...
2023/04/06 15:25:52 Job still running ...
2023/04/06 15:26:22 Job still running ...
2023/04/06 15:26:52 Job still running ...
2023/04/06 15:27:22 Job still running ...
2023/04/06 15:27:52 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-06_08_18_51-17396477248356965219 failed
--- FAIL: TestXLang_Partition (581.35s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3374.270s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680791536048947157
--- FAIL: TestBigQueryIO_BasicWriteRead (5.27s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40073 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hcbFRuuvbN" is_bounded:BOUNDED windowing_strategy_id:"w0@hcbFRuuvbN"}} windowing_strategies:{key:"w0@hcbFRuuvbN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hcbFRuuvbN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hcbFRuuvbN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hcbFRuuvbN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680791536048947157\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hcbFRuuvbN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40073 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hcbFRuuvbN" is_bounded:BOUNDED windowing_strategy_id:"w0@hcbFRuuvbN"}} windowing_strategies:{key:"w0@hcbFRuuvbN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hcbFRuuvbN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hcbFRuuvbN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hcbFRuuvbN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680791536048947157\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hcbFRuuvbN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc00048c300})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc00048c300})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e060?, 0xc00012e000?}, {0x113d039, 0x39}, {0xc0000f2000?, 0x104b4a0?, 0xc00064e000?}, {0xc00047cf50, 0xf}, 0xc0000ebd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012e000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000ebea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc000126008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.297s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:652a7a077abe1d314878070399425671005e8108ae3ec34c5b72d7664a09e20f
Associated tags:
- 20230406-143133
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-143133
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-143133].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:652a7a077abe1d314878070399425671005e8108ae3ec34c5b72d7664a09e20f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:956b236e6c635c3d849d3706dc896ab988a3cf474d82c9ec400aafb7ad787a93]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:956b236e6c635c3d849d3706dc896ab988a3cf474d82c9ec400aafb7ad787a93])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:956b236e6c635c3d849d3706dc896ab988a3cf474d82c9ec400aafb7ad787a93
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:956b236e6c635c3d849d3706dc896ab988a3cf474d82c9ec400aafb7ad787a93].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5684708242b77d9b0f58711fc731e8a69e81f9a7edd51d8bcb2d5f95976fce1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5684708242b77d9b0f58711fc731e8a69e81f9a7edd51d8bcb2d5f95976fce1])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5684708242b77d9b0f58711fc731e8a69e81f9a7edd51d8bcb2d5f95976fce1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5684708242b77d9b0f58711fc731e8a69e81f9a7edd51d8bcb2d5f95976fce1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 8s
232 actionable tasks: 162 executed, 58 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/dohixrdbanwzq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1492
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1492/display/redirect>
Changes:
------------------------------------------
[...truncated 1.08 MB...]
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406082044",
"environmentId": "sJojhwZomFbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-083321"
}
]
},
"name": "go-testxlang_partition-746",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/06 09:19:25 Submitted job: 2023-04-06_02_19_24-13661055678907016202
2023/04/06 09:19:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-06_02_19_24-13661055678907016202?project=apache-beam-testing
2023/04/06 09:19:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-06_02_19_24-13661055678907016202
2023/04/06 09:19:25 Job state: JOB_STATE_PENDING ...
2023/04/06 09:19:55 Job still running ...
2023/04/06 09:20:25 Job still running ...
2023/04/06 09:20:55 Job still running ...
2023/04/06 09:21:25 Job still running ...
2023/04/06 09:21:55 Job still running ...
2023/04/06 09:22:25 Job still running ...
2023/04/06 09:22:55 Job still running ...
2023/04/06 09:23:25 Job still running ...
2023/04/06 09:23:55 Job still running ...
2023/04/06 09:24:25 Job still running ...
2023/04/06 09:24:55 Job still running ...
2023/04/06 09:25:25 Job still running ...
2023/04/06 09:25:55 Job still running ...
2023/04/06 09:26:25 Job still running ...
2023/04/06 09:26:55 Job still running ...
2023/04/06 09:27:25 Job still running ...
2023/04/06 09:27:55 Job still running ...
2023/04/06 09:28:26 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-06_02_19_24-13661055678907016202 failed
--- FAIL: TestXLang_Partition (581.22s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3301.920s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680770037551175453
--- FAIL: TestBigQueryIO_BasicWriteRead (4.34s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43815 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PthEBpdqVo" is_bounded:BOUNDED windowing_strategy_id:"w0@PthEBpdqVo"}} windowing_strategies:{key:"w0@PthEBpdqVo" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PthEBpdqVo" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PthEBpdqVo" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PthEBpdqVo" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680770037551175453\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PthEBpdqVo"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43815 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@PthEBpdqVo" is_bounded:BOUNDED windowing_strategy_id:"w0@PthEBpdqVo"}} windowing_strategies:{key:"w0@PthEBpdqVo" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@PthEBpdqVo" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@PthEBpdqVo" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@PthEBpdqVo" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680770037551175453\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"PthEBpdqVo"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0003ea980})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0003ea980})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00048f680?, 0xc0004b4960?}, {0x113d039, 0x39}, {0xc0000f20c0?, 0x104b4a0?, 0xc0004b8d50?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00048f620?, 0xc0004b4960?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc0004f0270})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.363s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.022s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.019s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-083321
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-083321
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:495281fe00a24c234ab16e876f0d86ef8479ea8b494fbae0cd1e31c7ffd371af
Deleted: sha256:46eebb7928d87063109d746f51104201c6b12ef809b58ef265f3cfee5e5e79b1
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-083321
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:495281fe00a24c234ab16e876f0d86ef8479ea8b494fbae0cd1e31c7ffd371af
Associated tags:
- 20230406-083321
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-083321
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-083321].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:495281fe00a24c234ab16e876f0d86ef8479ea8b494fbae0cd1e31c7ffd371af].
$ rm -rf /tmp/tmp.hjAt5lJPyH
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406082044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a5c84ad877860624cfabbe9334fc9354986e6db2a7e7be4fd3f0d53d18befd2c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406082044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a5c84ad877860624cfabbe9334fc9354986e6db2a7e7be4fd3f0d53d18befd2c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406082044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a5c84ad877860624cfabbe9334fc9354986e6db2a7e7be4fd3f0d53d18befd2c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a5c84ad877860624cfabbe9334fc9354986e6db2a7e7be4fd3f0d53d18befd2c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a5c84ad877860624cfabbe9334fc9354986e6db2a7e7be4fd3f0d53d18befd2c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a5c84ad877860624cfabbe9334fc9354986e6db2a7e7be4fd3f0d53d18befd2c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406082044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25fc079a27f7330f2fec105c0f895150673c27feed5b485d80bc0fe3608b03fd
Deleted: sha256:56044080ae4e2ea5ea7b7ab0c3f180963efad39046723f0d75a60f4721f393f9
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406082044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25fc079a27f7330f2fec105c0f895150673c27feed5b485d80bc0fe3608b03fd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406082044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25fc079a27f7330f2fec105c0f895150673c27feed5b485d80bc0fe3608b03fd])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25fc079a27f7330f2fec105c0f895150673c27feed5b485d80bc0fe3608b03fd
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25fc079a27f7330f2fec105c0f895150673c27feed5b485d80bc0fe3608b03fd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25fc079a27f7330f2fec105c0f895150673c27feed5b485d80bc0fe3608b03fd].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 396143.
Stopping expansion service pid: 396144.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 39s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/qbaovnjv2dcxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1491
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1491/display/redirect>
Changes:
------------------------------------------
[...truncated 1.07 MB...]
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.48.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406022040",
"environmentId": "IIxbpEvaQrbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-023120"
}
]
},
"name": "go-testxlang_partition-850",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/06 03:17:18 Submitted job: 2023-04-05_20_17_18-8210252389556220438
2023/04/06 03:17:18 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-05_20_17_18-8210252389556220438?project=apache-beam-testing
2023/04/06 03:17:18 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-05_20_17_18-8210252389556220438
2023/04/06 03:17:18 Job state: JOB_STATE_PENDING ...
2023/04/06 03:17:48 Job still running ...
2023/04/06 03:18:18 Job still running ...
2023/04/06 03:18:48 Job still running ...
2023/04/06 03:19:18 Job still running ...
2023/04/06 03:19:48 Job still running ...
2023/04/06 03:20:18 Job still running ...
2023/04/06 03:20:48 Job still running ...
2023/04/06 03:21:18 Job still running ...
2023/04/06 03:21:48 Job still running ...
2023/04/06 03:22:18 Job still running ...
2023/04/06 03:22:49 Job still running ...
2023/04/06 03:23:19 Job still running ...
2023/04/06 03:23:49 Job still running ...
2023/04/06 03:24:19 Job still running ...
2023/04/06 03:24:49 Job still running ...
2023/04/06 03:25:19 Job still running ...
2023/04/06 03:25:49 Job still running ...
2023/04/06 03:26:19 Job still running ...
2023/04/06 03:26:49 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-05_20_17_18-8210252389556220438 failed
--- FAIL: TestXLang_Partition (610.55s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3326.920s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680748320342481784
--- FAIL: TestBigQueryIO_BasicWriteRead (5.06s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42189 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@BrfbtImhQn" is_bounded:BOUNDED windowing_strategy_id:"w0@BrfbtImhQn"}} windowing_strategies:{key:"w0@BrfbtImhQn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@BrfbtImhQn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@BrfbtImhQn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@BrfbtImhQn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680748320342481784\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"BrfbtImhQn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42189 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@BrfbtImhQn" is_bounded:BOUNDED windowing_strategy_id:"w0@BrfbtImhQn"}} windowing_strategies:{key:"w0@BrfbtImhQn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@BrfbtImhQn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@BrfbtImhQn" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@BrfbtImhQn" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680748320342481784\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"BrfbtImhQn"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 52 [running]:
testing.tRunner.func1.2({0xf70500, 0xc000416d80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc000416d80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a8440?, 0xc0000bc460?}, {0x113d039, 0x39}, {0xc0001560c0?, 0x104b4a0?, 0xc0000be9c0?}, {0xc00049eea0, 0xf}, 0xc0004f5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a83e0?, 0xc0000bc460?}, {0xc00004e300, 0x52}, {0x1?}, {0xc0004f5ea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00049eea0, 0xf}, {0xc00004e300, 0x52}, {0xebdac0, 0xc0000453a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003236c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003236c0, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.083s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.028s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.034s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-023120
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-023120
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:409a2680905060aee51c8dbf0501d7e19a8fef23a9ab70e2b6517d941f054591
Deleted: sha256:b49675c8090b8c7babf8b18151580424e7b63c66f8efd4954fd63676199105cb
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-023120
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:409a2680905060aee51c8dbf0501d7e19a8fef23a9ab70e2b6517d941f054591
Associated tags:
- 20230406-023120
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-023120
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230406-023120].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:409a2680905060aee51c8dbf0501d7e19a8fef23a9ab70e2b6517d941f054591].
$ rm -rf /tmp/tmp.iCoCtkOGPj
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a6d7ba9cf02b9f975bc83c09761c85c234fbdc6e8fc3207ff8b340b1b5d03bd
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a6d7ba9cf02b9f975bc83c09761c85c234fbdc6e8fc3207ff8b340b1b5d03bd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230406022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a6d7ba9cf02b9f975bc83c09761c85c234fbdc6e8fc3207ff8b340b1b5d03bd])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a6d7ba9cf02b9f975bc83c09761c85c234fbdc6e8fc3207ff8b340b1b5d03bd
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a6d7ba9cf02b9f975bc83c09761c85c234fbdc6e8fc3207ff8b340b1b5d03bd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5a6d7ba9cf02b9f975bc83c09761c85c234fbdc6e8fc3207ff8b340b1b5d03bd].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406022040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5301a43f78492d953244c6fe4f29fab8027f8b435dd7b11bb28d147fd2fe84bb
Deleted: sha256:0dc5eda0e1ab464b3fceb23d76f1ed9c51be52ac52cde0060d8517a2c70e640c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406022040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5301a43f78492d953244c6fe4f29fab8027f8b435dd7b11bb28d147fd2fe84bb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406022040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5301a43f78492d953244c6fe4f29fab8027f8b435dd7b11bb28d147fd2fe84bb])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5301a43f78492d953244c6fe4f29fab8027f8b435dd7b11bb28d147fd2fe84bb
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5301a43f78492d953244c6fe4f29fab8027f8b435dd7b11bb28d147fd2fe84bb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5301a43f78492d953244c6fe4f29fab8027f8b435dd7b11bb28d147fd2fe84bb].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 117183.
Stopping expansion service pid: 117184.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 5s
232 actionable tasks: 166 executed, 54 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/l4gh5qhdgoile
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1490
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1490/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-15 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3a0d71312a24641eb854c0255dcdfcaa759178fb (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3a0d71312a24641eb854c0255dcdfcaa759178fb # timeout=10
Commit message: "Revert "Moving to 2.48.0-SNAPSHOT on master branch.""
> git rev-list --no-walk e19d305763c4d7f47ce7a3f5fb029191f7fe8170 # timeout=10
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_GoUsingJava_Dataflow] $ /bin/bash -xe /tmp/jenkins1134856155274298925.sh
+ echo '*** RUN CROSS-LANGUAGE DATAFLOW GO WITH JAVA EXTERNAL TRANSFORMS ***'
*** RUN CROSS-LANGUAGE DATAFLOW GO WITH JAVA EXTERNAL TRANSFORMS ***
[Gradle] - Launching build.
FATAL: The Gradle wrapper has not been found in these directories: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src>
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1489
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1489/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/bigquery from 1.49.0 to 1.50.0 in /sdks
------------------------------------------
[...truncated 1.08 MB...]
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405142044",
"environmentId": "YXFOOnEQerbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-143115"
}
]
},
"name": "go-testxlang_partition-986",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/05 15:18:33 Submitted job: 2023-04-05_08_18_32-17123016744140844255
2023/04/05 15:18:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-05_08_18_32-17123016744140844255?project=apache-beam-testing
2023/04/05 15:18:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-05_08_18_32-17123016744140844255
2023/04/05 15:18:33 Job state: JOB_STATE_PENDING ...
2023/04/05 15:19:03 Job still running ...
2023/04/05 15:19:33 Job still running ...
2023/04/05 15:20:03 Job still running ...
2023/04/05 15:20:33 Job still running ...
2023/04/05 15:21:03 Job still running ...
2023/04/05 15:21:34 Job still running ...
2023/04/05 15:22:04 Job still running ...
2023/04/05 15:22:34 Job still running ...
2023/04/05 15:23:04 Job still running ...
2023/04/05 15:23:34 Job still running ...
2023/04/05 15:24:04 Job still running ...
2023/04/05 15:24:34 Job still running ...
2023/04/05 15:25:05 Job still running ...
2023/04/05 15:25:35 Job still running ...
2023/04/05 15:26:05 Job still running ...
2023/04/05 15:26:35 Job still running ...
2023/04/05 15:27:05 Job still running ...
2023/04/05 15:27:35 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-05_08_18_32-17123016744140844255 failed
--- FAIL: TestXLang_Partition (582.36s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3371.911s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680705121620006257
--- FAIL: TestBigQueryIO_BasicWriteRead (4.93s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34459 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@eLhsnTNTow" is_bounded:BOUNDED windowing_strategy_id:"w0@eLhsnTNTow"}} windowing_strategies:{key:"w0@eLhsnTNTow" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@eLhsnTNTow" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@eLhsnTNTow" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@eLhsnTNTow" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680705121620006257\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"eLhsnTNTow"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34459 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@eLhsnTNTow" is_bounded:BOUNDED windowing_strategy_id:"w0@eLhsnTNTow"}} windowing_strategies:{key:"w0@eLhsnTNTow" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@eLhsnTNTow" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@eLhsnTNTow" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@eLhsnTNTow" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680705121620006257\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"eLhsnTNTow"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf70500, 0xc0003ea0c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf70500, 0xc0003ea0c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00048f640?, 0xc00012c000?}, {0x113d039, 0x39}, {0xc0000f2000?, 0x104b4a0?, 0xc0004b8cf0?}, {0xc00047cf50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012c000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c5c0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00047cf50, 0xf}, {0xc00004efc0, 0x52}, {0xebdac0, 0xc000124008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e8b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e8b60, 0x116f518)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.957s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-143115
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-143115
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:aaf0e5404dd61395ea99bc03f2c099013d21c356a19b2bb98e0644739ce045af
Deleted: sha256:06a3278f89eb043367dc18da0fb76dcb39d49469273e2fdbb9e4297d140a507b
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-143115
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:aaf0e5404dd61395ea99bc03f2c099013d21c356a19b2bb98e0644739ce045af
Associated tags:
- 20230405-143115
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-143115
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-143115].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:aaf0e5404dd61395ea99bc03f2c099013d21c356a19b2bb98e0644739ce045af].
$ rm -rf /tmp/tmp.Ib8ruj15Ut
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405142044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3f81ef2a4cdb18da32edd90ef405c6633a90bf4df4a485270961c541f6a10265
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3f81ef2a4cdb18da32edd90ef405c6633a90bf4df4a485270961c541f6a10265]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3f81ef2a4cdb18da32edd90ef405c6633a90bf4df4a485270961c541f6a10265])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3f81ef2a4cdb18da32edd90ef405c6633a90bf4df4a485270961c541f6a10265
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3f81ef2a4cdb18da32edd90ef405c6633a90bf4df4a485270961c541f6a10265
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3f81ef2a4cdb18da32edd90ef405c6633a90bf4df4a485270961c541f6a10265].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405142044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a0e732af4d14582cf118fafc2fc2e94215fa7a14896c769774e49bfc2d25871
Deleted: sha256:685f9db74141a3f755497a9fdc1c7b82949561ad0f352e7209a57ed9f73c7c4b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405142044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a0e732af4d14582cf118fafc2fc2e94215fa7a14896c769774e49bfc2d25871]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405142044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a0e732af4d14582cf118fafc2fc2e94215fa7a14896c769774e49bfc2d25871])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a0e732af4d14582cf118fafc2fc2e94215fa7a14896c769774e49bfc2d25871
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a0e732af4d14582cf118fafc2fc2e94215fa7a14896c769774e49bfc2d25871
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a0e732af4d14582cf118fafc2fc2e94215fa7a14896c769774e49bfc2d25871].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3530698.
Stopping expansion service pid: 3530699.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 48s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/6bfhbvtg7bzey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1488
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1488/display/redirect>
Changes:
------------------------------------------
[...truncated 1.08 MB...]
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405082031",
"environmentId": "srmifMZxfibeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-083138"
}
]
},
"name": "go-testxlang_partition-702",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/05 09:18:38 Submitted job: 2023-04-05_02_18_38-13898416485344638584
2023/04/05 09:18:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-05_02_18_38-13898416485344638584?project=apache-beam-testing
2023/04/05 09:18:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-05_02_18_38-13898416485344638584
2023/04/05 09:18:38 Job state: JOB_STATE_PENDING ...
2023/04/05 09:19:08 Job still running ...
2023/04/05 09:19:38 Job still running ...
2023/04/05 09:20:08 Job still running ...
2023/04/05 09:20:38 Job still running ...
2023/04/05 09:21:09 Job still running ...
2023/04/05 09:21:39 Job still running ...
2023/04/05 09:22:09 Job still running ...
2023/04/05 09:22:39 Job still running ...
2023/04/05 09:23:09 Job still running ...
2023/04/05 09:23:39 Job still running ...
2023/04/05 09:24:09 Job still running ...
2023/04/05 09:24:39 Job still running ...
2023/04/05 09:25:09 Job still running ...
2023/04/05 09:25:39 Job still running ...
2023/04/05 09:26:09 Job still running ...
2023/04/05 09:26:39 Job still running ...
2023/04/05 09:27:09 Job still running ...
2023/04/05 09:27:39 Job still running ...
2023/04/05 09:28:09 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-05_02_18_38-13898416485344638584 failed
--- FAIL: TestXLang_Partition (613.68s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3390.870s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680683535095683083
--- FAIL: TestBigQueryIO_BasicWriteRead (4.36s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43851 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YNSeyyscJA" is_bounded:BOUNDED windowing_strategy_id:"w0@YNSeyyscJA"}} windowing_strategies:{key:"w0@YNSeyyscJA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YNSeyyscJA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YNSeyyscJA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YNSeyyscJA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680683535095683083\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YNSeyyscJA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43851 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YNSeyyscJA" is_bounded:BOUNDED windowing_strategy_id:"w0@YNSeyyscJA"}} windowing_strategies:{key:"w0@YNSeyyscJA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YNSeyyscJA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YNSeyyscJA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YNSeyyscJA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680683535095683083\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YNSeyyscJA"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf703e0, 0xc0000b3a00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf703e0, 0xc0000b3a00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00065c000?, 0xc00012e000?}, {0x113cab9, 0x39}, {0xc0004fc000?, 0x104b180?, 0xc0001100f0?}, {0xc000480f50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012e000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c520?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000480f50, 0xf}, {0xc00004efc0, 0x52}, {0xebda20, 0xc000128008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00035cb60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00035cb60, 0x116ef98)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.385s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-083138
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-083138
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:42d38a50c5bc0121e5959b81b5ea3a44562f8fa457b680060ac57bed04d32725
Deleted: sha256:5b8c88277b6b4aed826c0c5659cd985bf8c15dc188ea3ef380f821d0843b7bde
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-083138
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:42d38a50c5bc0121e5959b81b5ea3a44562f8fa457b680060ac57bed04d32725
Associated tags:
- 20230405-083138
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-083138
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-083138].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:42d38a50c5bc0121e5959b81b5ea3a44562f8fa457b680060ac57bed04d32725].
$ rm -rf /tmp/tmp.aWFBcngA6B
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405082031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f08bab262c1f5e8ce6dc37c55d56f13b35c2d683c291c192d5d260e7bda58e0f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f08bab262c1f5e8ce6dc37c55d56f13b35c2d683c291c192d5d260e7bda58e0f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f08bab262c1f5e8ce6dc37c55d56f13b35c2d683c291c192d5d260e7bda58e0f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f08bab262c1f5e8ce6dc37c55d56f13b35c2d683c291c192d5d260e7bda58e0f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f08bab262c1f5e8ce6dc37c55d56f13b35c2d683c291c192d5d260e7bda58e0f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f08bab262c1f5e8ce6dc37c55d56f13b35c2d683c291c192d5d260e7bda58e0f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405082031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cc3d6869572f37888cb7e08387b8b05698f5203af91c82a11267802f67a3667b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405082031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cc3d6869572f37888cb7e08387b8b05698f5203af91c82a11267802f67a3667b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405082031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cc3d6869572f37888cb7e08387b8b05698f5203af91c82a11267802f67a3667b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cc3d6869572f37888cb7e08387b8b05698f5203af91c82a11267802f67a3667b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cc3d6869572f37888cb7e08387b8b05698f5203af91c82a11267802f67a3667b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cc3d6869572f37888cb7e08387b8b05698f5203af91c82a11267802f67a3667b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3346397.
Stopping expansion service pid: 3346398.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 40s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ls6ywdiekrkje
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1487
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1487/display/redirect>
Changes:
------------------------------------------
[...truncated 1.08 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405022032",
"environmentId": "UWgEQclDwKbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-023108"
}
]
},
"name": "go-testxlang_partition-60",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/05 03:17:04 Submitted job: 2023-04-04_20_17_03-11189056314543153674
2023/04/05 03:17:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-04_20_17_03-11189056314543153674?project=apache-beam-testing
2023/04/05 03:17:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-04_20_17_03-11189056314543153674
2023/04/05 03:17:04 Job state: JOB_STATE_PENDING ...
2023/04/05 03:17:34 Job still running ...
2023/04/05 03:18:04 Job still running ...
2023/04/05 03:18:34 Job still running ...
2023/04/05 03:19:04 Job still running ...
2023/04/05 03:19:34 Job still running ...
2023/04/05 03:20:04 Job still running ...
2023/04/05 03:20:34 Job still running ...
2023/04/05 03:21:04 Job still running ...
2023/04/05 03:21:34 Job still running ...
2023/04/05 03:22:04 Job still running ...
2023/04/05 03:22:34 Job still running ...
2023/04/05 03:23:04 Job still running ...
2023/04/05 03:23:34 Job still running ...
2023/04/05 03:24:04 Job still running ...
2023/04/05 03:24:34 Job still running ...
2023/04/05 03:25:04 Job still running ...
2023/04/05 03:25:34 Job still running ...
2023/04/05 03:26:04 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-04_20_17_03-11189056314543153674 failed
--- FAIL: TestXLang_Partition (580.21s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3296.177s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680661902749604303
--- FAIL: TestBigQueryIO_BasicWriteRead (5.12s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44141 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xavyzgizuO" is_bounded:BOUNDED windowing_strategy_id:"w0@xavyzgizuO"}} windowing_strategies:{key:"w0@xavyzgizuO" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xavyzgizuO" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xavyzgizuO" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xavyzgizuO" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680661902749604303\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xavyzgizuO"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44141 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@xavyzgizuO" is_bounded:BOUNDED windowing_strategy_id:"w0@xavyzgizuO"}} windowing_strategies:{key:"w0@xavyzgizuO" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@xavyzgizuO" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@xavyzgizuO" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@xavyzgizuO" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680661902749604303\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"xavyzgizuO"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 20 [running]:
testing.tRunner.func1.2({0xf703e0, 0xc00049c340})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf703e0, 0xc00049c340})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00049e6c0?, 0xc0004c4820?}, {0x113cab9, 0x39}, {0xc0001560c0?, 0x104b180?, 0xc0004c8960?}, {0xc000498ea0, 0xf}, 0xc0000d1d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00049e5e0?, 0xc0004c4820?}, {0xc00010e540, 0x52}, {0x1?}, {0xc0000d1ea8, 0x2, 0xe7c520?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000498ea0, 0xf}, {0xc00010e540, 0x52}, {0xebda20, 0xc000499510})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031d6c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031d6c0, 0x116ef98)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.139s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.024s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.023s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.020s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-023108
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-023108
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1d1384392536c91b06a4b3c16f40fb9422bdaa310575cc5f7ecfb4a394f72804
Deleted: sha256:4d3f65dac9b0b1aa22d9a0bfd1c95452b3e1c7c0182ab2b03547fb606338671c
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-023108
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1d1384392536c91b06a4b3c16f40fb9422bdaa310575cc5f7ecfb4a394f72804
Associated tags:
- 20230405-023108
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-023108
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230405-023108].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:1d1384392536c91b06a4b3c16f40fb9422bdaa310575cc5f7ecfb4a394f72804].
$ rm -rf /tmp/tmp.VIPwahzfd3
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405022032
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f374c8a9ddeda40be885ee617a36beae24bf0c37d9dac4d40bec2997a586b1
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405022032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f374c8a9ddeda40be885ee617a36beae24bf0c37d9dac4d40bec2997a586b1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230405022032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f374c8a9ddeda40be885ee617a36beae24bf0c37d9dac4d40bec2997a586b1])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f374c8a9ddeda40be885ee617a36beae24bf0c37d9dac4d40bec2997a586b1
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f374c8a9ddeda40be885ee617a36beae24bf0c37d9dac4d40bec2997a586b1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d9f374c8a9ddeda40be885ee617a36beae24bf0c37d9dac4d40bec2997a586b1].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405022032
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f81ec863970a9f5dad12dbb623ac186e118fca7a86a62ab29d25afa7b4f34841
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405022032]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f81ec863970a9f5dad12dbb623ac186e118fca7a86a62ab29d25afa7b4f34841]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230405022032] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f81ec863970a9f5dad12dbb623ac186e118fca7a86a62ab29d25afa7b4f34841])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f81ec863970a9f5dad12dbb623ac186e118fca7a86a62ab29d25afa7b4f34841
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f81ec863970a9f5dad12dbb623ac186e118fca7a86a62ab29d25afa7b4f34841
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f81ec863970a9f5dad12dbb623ac186e118fca7a86a62ab29d25afa7b4f34841].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3171722.
Stopping expansion service pid: 3171723.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 27s
232 actionable tasks: 154 executed, 66 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/6iinmk2rga4iy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1486
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1486/display/redirect>
Changes:
------------------------------------------
[...truncated 1.08 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404202035",
"environmentId": "fwEMwuSxAXbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-203239"
}
]
},
"name": "go-testxlang_partition-349",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/04 21:18:08 Submitted job: 2023-04-04_14_18_07-4686842444623532182
2023/04/04 21:18:08 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-04_14_18_07-4686842444623532182?project=apache-beam-testing
2023/04/04 21:18:08 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-04_14_18_07-4686842444623532182
2023/04/04 21:18:08 Job state: JOB_STATE_PENDING ...
2023/04/04 21:18:38 Job still running ...
2023/04/04 21:19:08 Job still running ...
2023/04/04 21:19:38 Job still running ...
2023/04/04 21:20:08 Job still running ...
2023/04/04 21:20:38 Job still running ...
2023/04/04 21:21:08 Job still running ...
2023/04/04 21:21:38 Job still running ...
2023/04/04 21:22:08 Job still running ...
2023/04/04 21:22:38 Job still running ...
2023/04/04 21:23:08 Job still running ...
2023/04/04 21:23:38 Job still running ...
2023/04/04 21:24:09 Job still running ...
2023/04/04 21:24:39 Job still running ...
2023/04/04 21:25:09 Job still running ...
2023/04/04 21:25:39 Job still running ...
2023/04/04 21:26:09 Job still running ...
2023/04/04 21:26:39 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-04_14_18_07-4686842444623532182 failed
--- FAIL: TestXLang_Partition (550.73s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3238.095s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680640395123068769
--- FAIL: TestBigQueryIO_BasicWriteRead (5.50s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38481 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AQXFfraaru" is_bounded:BOUNDED windowing_strategy_id:"w0@AQXFfraaru"}} windowing_strategies:{key:"w0@AQXFfraaru" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AQXFfraaru" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AQXFfraaru" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AQXFfraaru" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680640395123068769\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AQXFfraaru"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38481 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AQXFfraaru" is_bounded:BOUNDED windowing_strategy_id:"w0@AQXFfraaru"}} windowing_strategies:{key:"w0@AQXFfraaru" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AQXFfraaru" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AQXFfraaru" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AQXFfraaru" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680640395123068769\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AQXFfraaru"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf703e0, 0xc0003e00c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf703e0, 0xc0003e00c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e0a0?, 0xc00012e000?}, {0x113cab9, 0x39}, {0xc000166000?, 0x104b180?, 0xc0001100f0?}, {0xc000480f50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012e000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7c520?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000480f50, 0xf}, {0xc00004efc0, 0x52}, {0xebda20, 0xc000128008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00035eb60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00035eb60, 0x116ef98)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.519s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.027s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.051s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-203239
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-203239
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0328eac686a9b8bc46114479780b0ffbb7a541de144f24d60147706ba917a6e7
Deleted: sha256:6ce3944ed0bad2ea459485a8bb5b9c3096ee0e2c44a408efa61b17e9d0b358d3
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-203239
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0328eac686a9b8bc46114479780b0ffbb7a541de144f24d60147706ba917a6e7
Associated tags:
- 20230404-203239
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-203239
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-203239].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:0328eac686a9b8bc46114479780b0ffbb7a541de144f24d60147706ba917a6e7].
$ rm -rf /tmp/tmp.kQAUR2EAWN
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404202035
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3cd72dca1639d5f9b95ba9ba023d3a04fde19d8c826316c42db4d71125e26df5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404202035]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3cd72dca1639d5f9b95ba9ba023d3a04fde19d8c826316c42db4d71125e26df5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404202035] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3cd72dca1639d5f9b95ba9ba023d3a04fde19d8c826316c42db4d71125e26df5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3cd72dca1639d5f9b95ba9ba023d3a04fde19d8c826316c42db4d71125e26df5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3cd72dca1639d5f9b95ba9ba023d3a04fde19d8c826316c42db4d71125e26df5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3cd72dca1639d5f9b95ba9ba023d3a04fde19d8c826316c42db4d71125e26df5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404202035
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1be7b075ff6ccaffdf6f0579568c678c6c674d380eadaf8a57fb0ee70524661d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404202035]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1be7b075ff6ccaffdf6f0579568c678c6c674d380eadaf8a57fb0ee70524661d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404202035] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1be7b075ff6ccaffdf6f0579568c678c6c674d380eadaf8a57fb0ee70524661d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1be7b075ff6ccaffdf6f0579568c678c6c674d380eadaf8a57fb0ee70524661d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1be7b075ff6ccaffdf6f0579568c678c6c674d380eadaf8a57fb0ee70524661d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1be7b075ff6ccaffdf6f0579568c678c6c674d380eadaf8a57fb0ee70524661d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2422032.
Stopping expansion service pid: 2422033.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 1s
232 actionable tasks: 168 executed, 54 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/gzsfhm5novfh4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1485
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1485/display/redirect?page=changes>
Changes:
[noreply] Fix compatibility with dill 0.3.6. #26086
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404144357",
"environmentId": "MNqaSqtiAzbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-145505"
}
]
},
"name": "go-testxlang_partition-222",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/04 15:39:39 Submitted job: 2023-04-04_08_39_39-2980114606881758355
2023/04/04 15:39:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-04_08_39_39-2980114606881758355?project=apache-beam-testing
2023/04/04 15:39:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-04_08_39_39-2980114606881758355
2023/04/04 15:39:39 Job state: JOB_STATE_PENDING ...
2023/04/04 15:40:09 Job still running ...
2023/04/04 15:40:39 Job still running ...
2023/04/04 15:41:09 Job still running ...
2023/04/04 15:41:39 Job still running ...
2023/04/04 15:42:09 Job still running ...
2023/04/04 15:42:40 Job still running ...
2023/04/04 15:43:10 Job still running ...
2023/04/04 15:43:40 Job still running ...
2023/04/04 15:44:10 Job still running ...
2023/04/04 15:44:40 Job still running ...
2023/04/04 15:45:10 Job still running ...
2023/04/04 15:45:40 Job still running ...
2023/04/04 15:46:10 Job still running ...
2023/04/04 15:46:40 Job still running ...
2023/04/04 15:47:10 Job still running ...
2023/04/04 15:47:40 Job still running ...
2023/04/04 15:48:10 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-04_08_39_39-2980114606881758355 failed
--- FAIL: TestXLang_Partition (550.72s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3183.683s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680620144843722865
--- FAIL: TestBigQueryIO_BasicWriteRead (5.46s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39209 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RSvldeeLcK" is_bounded:BOUNDED windowing_strategy_id:"w0@RSvldeeLcK"}} windowing_strategies:{key:"w0@RSvldeeLcK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RSvldeeLcK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RSvldeeLcK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RSvldeeLcK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680620144843722865\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RSvldeeLcK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39209 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RSvldeeLcK" is_bounded:BOUNDED windowing_strategy_id:"w0@RSvldeeLcK"}} windowing_strategies:{key:"w0@RSvldeeLcK" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RSvldeeLcK" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RSvldeeLcK" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RSvldeeLcK" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680620144843722865\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RSvldeeLcK"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 20 [running]:
testing.tRunner.func1.2({0xf703e0, 0xc0004ca8c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf703e0, 0xc0004ca8c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00059e0c0?, 0xc0005a4050?}, {0x113cab9, 0x39}, {0xc0001560c0?, 0x104b180?, 0xc0005a2120?}, {0xc000498ea0, 0xf}, 0xc000153d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00059e060?, 0xc0005a4050?}, {0xc00004e300, 0x52}, {0x1?}, {0xc000153ea8, 0x2, 0xe7c520?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000498ea0, 0xf}, {0xc00004e300, 0x52}, {0xebda20, 0xc000590068})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031b6c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031b6c0, 0x116ef98)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.477s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.022s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.022s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.020s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-145505
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-145505
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:edc58129dd9ecb68e81b014a71899391627deb04be957950092a7ff8c1af6339
Deleted: sha256:35665a681eddd24c238b2b171a5e290717777738421988d17dccf9461a1861e9
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-145505
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:edc58129dd9ecb68e81b014a71899391627deb04be957950092a7ff8c1af6339
Associated tags:
- 20230404-145505
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-145505
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230404-145505].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:edc58129dd9ecb68e81b014a71899391627deb04be957950092a7ff8c1af6339].
$ rm -rf /tmp/tmp.rX2WwEc6iO
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404144357
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0b3c6456216774e9152b55da7ea882a0e0e8aaf121a661a098bca3c2d6a32562
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404144357]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0b3c6456216774e9152b55da7ea882a0e0e8aaf121a661a098bca3c2d6a32562]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404144357] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0b3c6456216774e9152b55da7ea882a0e0e8aaf121a661a098bca3c2d6a32562])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0b3c6456216774e9152b55da7ea882a0e0e8aaf121a661a098bca3c2d6a32562
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0b3c6456216774e9152b55da7ea882a0e0e8aaf121a661a098bca3c2d6a32562
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0b3c6456216774e9152b55da7ea882a0e0e8aaf121a661a098bca3c2d6a32562].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404144357
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f601ad4bfdc56316fbc18344e7539362780303e1a8bee571c2db070e8688afc
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404144357]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f601ad4bfdc56316fbc18344e7539362780303e1a8bee571c2db070e8688afc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404144357] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f601ad4bfdc56316fbc18344e7539362780303e1a8bee571c2db070e8688afc])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f601ad4bfdc56316fbc18344e7539362780303e1a8bee571c2db070e8688afc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f601ad4bfdc56316fbc18344e7539362780303e1a8bee571c2db070e8688afc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f601ad4bfdc56316fbc18344e7539362780303e1a8bee571c2db070e8688afc].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1595478.
Stopping expansion service pid: 1595479.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 10s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/v75lam3d5hiaq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1484
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1484/display/redirect>
Changes:
------------------------------------------
[...truncated 621.66 KB...]
#16 1.098 PyYAML==6.0
#16 1.098 regex==2023.3.23
#16 1.098 requests==2.28.2
#16 1.098 requests-mock==1.10.0
#16 1.098 requests-oauthlib==1.3.1
#16 1.098 rsa==4.9
#16 1.098 scikit-learn==1.2.2
#16 1.098 scipy==1.10.1
#16 1.098 setuptools==67.6.1
#16 1.098 six==1.16.0
#16 1.098 sortedcontainers==2.4.0
#16 1.098 soupsieve==2.4
#16 1.098 SQLAlchemy==1.4.47
#16 1.098 sqlparse==0.4.3
#16 1.098 tenacity==5.1.5
#16 1.098 tensorboard==2.12.0
#16 1.098 tensorboard-data-server==0.7.0
#16 1.098 tensorboard-plugin-wit==1.8.1
#16 1.098 tensorflow==2.12.0
#16 1.098 tensorflow-estimator==2.12.0
#16 1.098 tensorflow-io-gcs-filesystem==0.32.0
#16 1.098 termcolor==2.2.0
#16 1.098 testcontainers==3.7.1
#16 1.098 threadpoolctl==3.1.0
#16 1.098 tomli==2.0.1
#16 1.098 tqdm==4.65.0
#16 1.098 typing_extensions==4.5.0
#16 1.098 urllib3==1.26.15
#16 1.098 websocket-client==1.5.1
#16 1.098 Werkzeug==2.2.3
#16 1.098 wheel==0.40.0
#16 1.098 wrapt==1.14.1
#16 1.098 zipp==3.15.0
#16 1.098 zstandard==0.20.0
#16 DONE 2.4s
#17 [beam 13/16] COPY target/LICENSE /opt/apache/beam/
#17 DONE 0.1s
#18 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/
#18 DONE 0.1s
#19 [beam 15/16] COPY target/NOTICE /opt/apache/beam/
#19 DONE 0.1s
#20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/
#20 DONE 0.2s
#21 [third_party_licenses 1/5] COPY target/license_scripts /tmp/license_scripts/
#21 DONE 0.1s
#22 [third_party_licenses 2/5] COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#22 DONE 0.1s
#23 [third_party_licenses 3/5] RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
#23 DONE 0.3s
#24 [third_party_licenses 4/5] COPY target/license_scripts /tmp/license_scripts/
#24 DONE 0.0s
#25 [third_party_licenses 5/5] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#25 1.223 Collecting pip-licenses<5
#25 1.298 Downloading pip_licenses-4.1.0-py3-none-any.whl (18 kB)
#25 1.307 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0)
#25 1.308 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (5.1.5)
#25 1.369 Collecting prettytable>=2.3.0
#25 1.384 Downloading prettytable-3.6.0-py3-none-any.whl (27 kB)
#25 1.413 Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.8/site-packages (from tenacity) (1.16.0)
#25 1.459 Collecting wcwidth
#25 1.474 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#25 2.818 Installing collected packages: wcwidth, prettytable, pip-licenses
#25 3.018 Successfully installed pip-licenses-4.1.0 prettytable-3.6.0 wcwidth-0.2.6
#25 3.018 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#25 15.10 INFO:root:Successfully pulled licenses for 133 dependencies
#25 15.10 Skip pulling license for bs4
#25 DONE 15.4s
#26 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#26 DONE 0.1s
#27 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#27 DONE 0.3s
#28 exporting to image
#28 exporting layers
#28 exporting layers 15.6s done
#28 writing image sha256:fa1d0b1a83bdd5bd6a1d9d5f1936f66cdf26173f6dd7173a3323aceb33e11b65 done
#28 naming to docker.io/apache/beam_python3.8_sdk:2.47.0.dev done
#28 DONE 15.6s
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
6344cf968042: Preparing
00cad58f1a83: Preparing
3b37183f8714: Preparing
25d83d9b5813: Preparing
4c50c6eb45c5: Preparing
bb812604f586: Preparing
6a5c7b0e030b: Preparing
ea561c3189a3: Preparing
8368c449c9a8: Preparing
5b4ddd011ba0: Preparing
0b2851136801: Preparing
df35a81e409e: Preparing
e0ed0ed4dd2b: Preparing
f449013ca394: Preparing
b24ece04a22e: Preparing
676475b824c2: Preparing
d1dadb26eeac: Preparing
cc8465ede3c6: Preparing
863eba1bb8a1: Preparing
b4f8c0d84a26: Preparing
5c563cc8b216: Preparing
d4514f8b2aac: Preparing
5ab567b9150b: Preparing
a90e3914fb92: Preparing
053a1f71007e: Preparing
ec09eb83ea03: Preparing
bb812604f586: Waiting
6a5c7b0e030b: Waiting
df35a81e409e: Waiting
ea561c3189a3: Waiting
e0ed0ed4dd2b: Waiting
a90e3914fb92: Waiting
053a1f71007e: Waiting
8368c449c9a8: Waiting
f449013ca394: Waiting
ec09eb83ea03: Waiting
5b4ddd011ba0: Waiting
d1dadb26eeac: Waiting
b4f8c0d84a26: Waiting
0b2851136801: Waiting
b24ece04a22e: Waiting
676475b824c2: Waiting
5c563cc8b216: Waiting
863eba1bb8a1: Waiting
5ab567b9150b: Waiting
d4514f8b2aac: Waiting
4c50c6eb45c5: Pushed
25d83d9b5813: Pushed
00cad58f1a83: Pushed
3b37183f8714: Pushed
bb812604f586: Pushed
6a5c7b0e030b: Pushed
ea561c3189a3: Pushed
6344cf968042: Pushed
df35a81e409e: Pushed
0b2851136801: Pushed
5b4ddd011ba0: Pushed
676475b824c2: Pushed
d1dadb26eeac: Pushed
cc8465ede3c6: Layer already exists
863eba1bb8a1: Layer already exists
b4f8c0d84a26: Layer already exists
5c563cc8b216: Layer already exists
f449013ca394: Pushed
d4514f8b2aac: Layer already exists
5ab567b9150b: Layer already exists
a90e3914fb92: Layer already exists
053a1f71007e: Layer already exists
ec09eb83ea03: Layer already exists
8368c449c9a8: Pushed
e0ed0ed4dd2b: Pushed
b24ece04a22e: Pushed
20230404083250: digest: sha256:a84055625293545843c450b608e602e0e04ae2d10f9f4caf0dfb60b1488c2f2f size: 5774
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 38559
Launching Python expansion service @ 36655
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404083250
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a84055625293545843c450b608e602e0e04ae2d10f9f4caf0dfb60b1488c2f2f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404083250]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a84055625293545843c450b608e602e0e04ae2d10f9f4caf0dfb60b1488c2f2f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404083250] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a84055625293545843c450b608e602e0e04ae2d10f9f4caf0dfb60b1488c2f2f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a84055625293545843c450b608e602e0e04ae2d10f9f4caf0dfb60b1488c2f2f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a84055625293545843c450b608e602e0e04ae2d10f9f4caf0dfb60b1488c2f2f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a84055625293545843c450b608e602e0e04ae2d10f9f4caf0dfb60b1488c2f2f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404083250
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:536adfd071dc6ca7d62284f91b7b6b42d10ba7a75099880277e4bc9a8bdf01c5
Deleted: sha256:dd76347c559937ae96108a9c9d0baf9362a62577697935f654a5d38c242e33f7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404083250]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:536adfd071dc6ca7d62284f91b7b6b42d10ba7a75099880277e4bc9a8bdf01c5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404083250] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:536adfd071dc6ca7d62284f91b7b6b42d10ba7a75099880277e4bc9a8bdf01c5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:536adfd071dc6ca7d62284f91b7b6b42d10ba7a75099880277e4bc9a8bdf01c5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:536adfd071dc6ca7d62284f91b7b6b42d10ba7a75099880277e4bc9a8bdf01c5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:536adfd071dc6ca7d62284f91b7b6b42d10ba7a75099880277e4bc9a8bdf01c5].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1484836.
Stopping expansion service pid: 1484837.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:expansion-service:analyzeClassesDependencies'.
> Failed to load cache entry 3f8dbb393c207c6ee163423945b1da51 for task ':sdks:java:io:expansion-service:analyzeClassesDependencies': Could not load from local cache: Timeout waiting to lock Build cache (/home/jenkins/.gradle/caches/build-cache-1). It is currently in use by another Gradle instance.
Owner PID: 1395329
Our PID: 1412350
Owner Operation:
Our operation:
Lock file: /home/jenkins/.gradle/caches/build-cache-1/build-cache-1.lock
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 15m 34s
231 actionable tasks: 152 executed, 67 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/77asjb7xwv6f2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1483
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1483/display/redirect>
Changes:
------------------------------------------
[...truncated 631.34 KB...]
#16 1.039 hypothesis==6.70.1
#16 1.039 idna==3.4
#16 1.039 importlib-metadata==6.1.0
#16 1.039 iniconfig==2.0.0
#16 1.039 jax==0.4.8
#16 1.039 joblib==1.2.0
#16 1.039 keras==2.12.0
#16 1.039 libclang==16.0.0
#16 1.039 Markdown==3.4.3
#16 1.039 MarkupSafe==2.1.2
#16 1.039 ml-dtypes==0.0.4
#16 1.039 mmh3==3.1.0
#16 1.039 mock==5.0.1
#16 1.039 nltk==3.8.1
#16 1.039 nose==1.3.7
#16 1.039 numpy==1.23.5
#16 1.039 oauth2client==4.1.3
#16 1.039 oauthlib==3.2.2
#16 1.039 objsize==0.6.1
#16 1.039 opt-einsum==3.3.0
#16 1.039 orjson==3.8.9
#16 1.039 overrides==6.5.0
#16 1.039 packaging==23.0
#16 1.039 pandas==1.5.3
#16 1.039 parameterized==0.8.1
#16 1.039 pip==23.0.1
#16 1.039 pluggy==1.0.0
#16 1.039 proto-plus==1.22.2
#16 1.039 protobuf==4.22.1
#16 1.039 psycopg2-binary==2.9.5
#16 1.039 pyarrow==9.0.0
#16 1.039 pyasn1==0.4.8
#16 1.039 pyasn1-modules==0.2.8
#16 1.039 pycparser==2.21
#16 1.039 pydot==1.4.2
#16 1.039 PyHamcrest==1.10.1
#16 1.039 pymongo==4.3.3
#16 1.039 PyMySQL==1.0.3
#16 1.039 pyparsing==3.0.9
#16 1.039 pytest==7.2.2
#16 1.039 pytest-timeout==2.1.0
#16 1.039 pytest-xdist==3.2.1
#16 1.039 python-dateutil==2.8.2
#16 1.039 python-snappy==0.6.1
#16 1.039 pytz==2023.3
#16 1.039 PyYAML==6.0
#16 1.039 regex==2023.3.23
#16 1.039 requests==2.28.2
#16 1.039 requests-mock==1.10.0
#16 1.039 requests-oauthlib==1.3.1
#16 1.039 rsa==4.9
#16 1.039 scikit-learn==1.2.2
#16 1.039 scipy==1.10.1
#16 1.039 setuptools==67.6.1
#16 1.039 six==1.16.0
#16 1.039 sortedcontainers==2.4.0
#16 1.039 soupsieve==2.4
#16 1.039 SQLAlchemy==1.4.47
#16 1.039 sqlparse==0.4.3
#16 1.039 tenacity==5.1.5
#16 1.039 tensorboard==2.12.0
#16 1.039 tensorboard-data-server==0.7.0
#16 1.039 tensorboard-plugin-wit==1.8.1
#16 1.039 tensorflow==2.12.0
#16 1.039 tensorflow-estimator==2.12.0
#16 1.039 tensorflow-io-gcs-filesystem==0.32.0
#16 1.039 termcolor==2.2.0
#16 1.039 testcontainers==3.7.1
#16 1.039 threadpoolctl==3.1.0
#16 1.039 tomli==2.0.1
#16 1.039 tqdm==4.65.0
#16 1.039 typing_extensions==4.5.0
#16 1.039 urllib3==1.26.15
#16 1.039 websocket-client==1.5.1
#16 1.039 Werkzeug==2.2.3
#16 1.039 wheel==0.40.0
#16 1.039 wrapt==1.14.1
#16 1.039 zipp==3.15.0
#16 1.039 zstandard==0.20.0
#16 DONE 1.1s
#17 [beam 13/16] COPY target/LICENSE /opt/apache/beam/
#17 DONE 0.0s
#18 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/
#18 DONE 0.0s
#19 [beam 15/16] COPY target/NOTICE /opt/apache/beam/
#19 DONE 0.0s
#20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/
#20 DONE 0.2s
#21 [third_party_licenses 1/5] COPY target/license_scripts /tmp/license_scripts/
#21 DONE 0.1s
#22 [third_party_licenses 2/5] COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#22 DONE 0.1s
#23 [third_party_licenses 3/5] RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
#23 DONE 0.3s
#24 [third_party_licenses 4/5] COPY target/license_scripts /tmp/license_scripts/
#24 DONE 0.0s
#25 [third_party_licenses 5/5] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#25 1.110 Collecting pip-licenses<5
#25 1.189 Downloading pip_licenses-4.1.0-py3-none-any.whl (18 kB)
#25 1.198 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0)
#25 1.198 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (5.1.5)
#25 1.257 Collecting prettytable>=2.3.0
#25 1.274 Downloading prettytable-3.6.0-py3-none-any.whl (27 kB)
#25 1.294 Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.8/site-packages (from tenacity) (1.16.0)
#25 1.340 Collecting wcwidth
#25 1.363 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#25 2.550 Installing collected packages: wcwidth, prettytable, pip-licenses
#25 2.716 Successfully installed pip-licenses-4.1.0 prettytable-3.6.0 wcwidth-0.2.6
#25 2.717 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#25 9.725 INFO:root:Successfully pulled licenses for 133 dependencies
#25 9.725 Skip pulling license for bs4
#25 DONE 9.8s
#26 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#26 DONE 0.1s
#27 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#27 DONE 0.4s
#28 exporting to image
#28 exporting layers
#28 exporting layers 14.0s done
#28 writing image sha256:58245ff93548fc2ec7df805a1df705ed9556934e2e73558fa6dd39706ae93211 done
#28 naming to docker.io/apache/beam_python3.8_sdk:2.47.0.dev done
#28 DONE 14.0s
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
8deae2c1685e: Preparing
325a644f0a9e: Preparing
f49b7956987e: Preparing
a698539c4bab: Preparing
2671869829dd: Preparing
c06cb3d0bec7: Preparing
8975bd08e149: Preparing
152d064c5a99: Preparing
d505dc941f4c: Preparing
29ab6609f3ac: Preparing
87da2ec7191c: Preparing
98cfcde72c55: Preparing
413767741497: Preparing
c4d085a02543: Preparing
bcdaa99ac429: Preparing
35187c9ed1f5: Preparing
8085d504f70d: Preparing
cc8465ede3c6: Preparing
863eba1bb8a1: Preparing
c06cb3d0bec7: Waiting
b4f8c0d84a26: Preparing
5c563cc8b216: Preparing
d4514f8b2aac: Preparing
d505dc941f4c: Waiting
5ab567b9150b: Preparing
8975bd08e149: Waiting
152d064c5a99: Waiting
29ab6609f3ac: Waiting
c4d085a02543: Waiting
87da2ec7191c: Waiting
bcdaa99ac429: Waiting
413767741497: Waiting
d4514f8b2aac: Waiting
35187c9ed1f5: Waiting
a90e3914fb92: Preparing
98cfcde72c55: Waiting
053a1f71007e: Preparing
cc8465ede3c6: Waiting
ec09eb83ea03: Preparing
b4f8c0d84a26: Waiting
863eba1bb8a1: Waiting
5ab567b9150b: Waiting
a90e3914fb92: Waiting
053a1f71007e: Waiting
ec09eb83ea03: Waiting
2671869829dd: Pushed
a698539c4bab: Pushed
325a644f0a9e: Pushed
8deae2c1685e: Pushed
f49b7956987e: Pushed
8975bd08e149: Pushed
c06cb3d0bec7: Pushed
152d064c5a99: Pushed
29ab6609f3ac: Pushed
98cfcde72c55: Pushed
87da2ec7191c: Pushed
35187c9ed1f5: Pushed
8085d504f70d: Pushed
cc8465ede3c6: Layer already exists
863eba1bb8a1: Layer already exists
b4f8c0d84a26: Layer already exists
c4d085a02543: Pushed
5c563cc8b216: Layer already exists
5ab567b9150b: Layer already exists
d4514f8b2aac: Layer already exists
a90e3914fb92: Layer already exists
053a1f71007e: Layer already exists
ec09eb83ea03: Layer already exists
d505dc941f4c: Pushed
413767741497: Pushed
bcdaa99ac429: Pushed
20230404022044: digest: sha256:1a69627e8cdbaa1dd91e9975df22a99771fb027383cc479c35e656169a72c74c size: 5774
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 10m 57s
223 actionable tasks: 143 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/elkjkrkupc2oo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1482
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1482/display/redirect?page=changes>
Changes:
[noreply] Remove accidental commit (#26081)
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403202039",
"environmentId": "UhkXiVHAvLbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.47.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-203132",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-203132"
}
]
},
"name": "go-testxlang_partition-162",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/03 21:19:13 Submitted job: 2023-04-03_14_19_13-2562599782560164756
2023/04/03 21:19:13 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-03_14_19_13-2562599782560164756?project=apache-beam-testing
2023/04/03 21:19:13 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-03_14_19_13-2562599782560164756
2023/04/03 21:19:13 Job state: JOB_STATE_PENDING ...
2023/04/03 21:19:43 Job still running ...
2023/04/03 21:20:13 Job still running ...
2023/04/03 21:20:44 Job still running ...
2023/04/03 21:21:14 Job still running ...
2023/04/03 21:21:44 Job still running ...
2023/04/03 21:22:14 Job still running ...
2023/04/03 21:22:44 Job still running ...
2023/04/03 21:23:14 Job still running ...
2023/04/03 21:23:44 Job still running ...
2023/04/03 21:24:14 Job still running ...
2023/04/03 21:24:44 Job still running ...
2023/04/03 21:25:14 Job still running ...
2023/04/03 21:25:44 Job still running ...
2023/04/03 21:26:14 Job still running ...
2023/04/03 21:26:44 Job still running ...
2023/04/03 21:27:14 Job still running ...
2023/04/03 21:27:44 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-03_14_19_13-2562599782560164756 failed
--- FAIL: TestXLang_Partition (554.13s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3368.845s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680553933885564750
--- FAIL: TestBigQueryIO_BasicWriteRead (5.62s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42663 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sZMsehtzKZ" is_bounded:BOUNDED windowing_strategy_id:"w0@sZMsehtzKZ"}} windowing_strategies:{key:"w0@sZMsehtzKZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sZMsehtzKZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sZMsehtzKZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sZMsehtzKZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680553933885564750\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sZMsehtzKZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42663 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sZMsehtzKZ" is_bounded:BOUNDED windowing_strategy_id:"w0@sZMsehtzKZ"}} windowing_strategies:{key:"w0@sZMsehtzKZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sZMsehtzKZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sZMsehtzKZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sZMsehtzKZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680553933885564750\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sZMsehtzKZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf703e0, 0xc000486d80})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf703e0, 0xc000486d80})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000488040?, 0xc00051c000?}, {0x113cab9, 0x39}, {0xc000138000?, 0x104b180?, 0xc0005040c0?}, {0xc000480f50, 0xf}, 0xc0000ebd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000512020?, 0xc00051c000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000ebea8, 0x2, 0xe7c520?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000480f50, 0xf}, {0xc00004efc0, 0x52}, {0xebda20, 0xc000514008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00035eb60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00035eb60, 0x116ef98)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.644s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.024s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.020s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7eb9ae0287453028e2eefe2ad24e712f560773df09540e1234d558b55c4b0363
Associated tags:
- 20230403-203132
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-203132
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-203132].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7eb9ae0287453028e2eefe2ad24e712f560773df09540e1234d558b55c4b0363].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1dd89134e0e2717adbddfa623d9ab700d2f88b86275c088c018b6c9e4a404e6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1dd89134e0e2717adbddfa623d9ab700d2f88b86275c088c018b6c9e4a404e6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1dd89134e0e2717adbddfa623d9ab700d2f88b86275c088c018b6c9e4a404e6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1dd89134e0e2717adbddfa623d9ab700d2f88b86275c088c018b6c9e4a404e6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403202039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f07bd4f8d358bb92a5a5eb45bfffc64eeaae1c186559505338f2f2b83cba0ab]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403202039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f07bd4f8d358bb92a5a5eb45bfffc64eeaae1c186559505338f2f2b83cba0ab])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f07bd4f8d358bb92a5a5eb45bfffc64eeaae1c186559505338f2f2b83cba0ab
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f07bd4f8d358bb92a5a5eb45bfffc64eeaae1c186559505338f2f2b83cba0ab].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 5s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/pqhv4m2phzrhu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1481
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1481/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403142040",
"environmentId": "RXFvXJTCXbbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-143119"
}
]
},
"name": "go-testxlang_partition-969",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/03 15:17:55 Submitted job: 2023-04-03_08_17_54-13532306967103936016
2023/04/03 15:17:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-03_08_17_54-13532306967103936016?project=apache-beam-testing
2023/04/03 15:17:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-03_08_17_54-13532306967103936016
2023/04/03 15:17:55 Job state: JOB_STATE_PENDING ...
2023/04/03 15:18:25 Job still running ...
2023/04/03 15:18:55 Job still running ...
2023/04/03 15:19:25 Job still running ...
2023/04/03 15:19:55 Job still running ...
2023/04/03 15:20:25 Job still running ...
2023/04/03 15:20:55 Job still running ...
2023/04/03 15:21:25 Job still running ...
2023/04/03 15:21:55 Job still running ...
2023/04/03 15:22:25 Job still running ...
2023/04/03 15:22:55 Job still running ...
2023/04/03 15:23:25 Job still running ...
2023/04/03 15:23:55 Job still running ...
2023/04/03 15:24:25 Job still running ...
2023/04/03 15:24:55 Job still running ...
2023/04/03 15:25:26 Job still running ...
2023/04/03 15:25:56 Job still running ...
2023/04/03 15:26:26 Job still running ...
2023/04/03 15:26:56 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-03_08_17_54-13532306967103936016 failed
--- FAIL: TestXLang_Partition (580.97s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3334.452s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680532315112884213
--- FAIL: TestBigQueryIO_BasicWriteRead (4.64s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36471 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sxDexqYIBk" is_bounded:BOUNDED windowing_strategy_id:"w0@sxDexqYIBk"}} windowing_strategies:{key:"w0@sxDexqYIBk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sxDexqYIBk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sxDexqYIBk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sxDexqYIBk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680532315112884213\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sxDexqYIBk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36471 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sxDexqYIBk" is_bounded:BOUNDED windowing_strategy_id:"w0@sxDexqYIBk"}} windowing_strategies:{key:"w0@sxDexqYIBk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sxDexqYIBk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sxDexqYIBk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sxDexqYIBk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680532315112884213\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sxDexqYIBk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf6f100, 0xc0004b4a00})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf6f100, 0xc0004b4a00})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000654020?, 0xc00012c000?}, {0x113b5e2, 0x39}, {0xc0004fa000?, 0x1049ee0?, 0xc0001100f0?}, {0xc000480f50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e040?, 0xc00012c000?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7b460?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000480f50, 0xf}, {0xc00004efc0, 0x52}, {0xebc8a0, 0xc000124008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00035eb60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00035eb60, 0x116da28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.656s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-143119
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-143119
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a12ca576db812f09971572da40d68cee4855b559664ce411f2c248d3bf1ee7be
Deleted: sha256:2817ba1615aeffc0c6a7ab740ae4e6c4d786e6689e904f4b23d12d58b3bffb09
Deleted: sha256:740e432af40fb96d7722316ef6fad8aa081909c686b0db7b088ba1ee44775d5b
Deleted: sha256:71b33885d800f4522b986664e2da00fbc1abb5e42a673cdfe151329061a8e214
Deleted: sha256:a32d2979556138fc1eaed02a7ced6ba88bed037d6007a4030d4091e5c8d52154
Deleted: sha256:aae239b383879bec6573620c7c4474d21b57705d76631fc1ff3cc00573a3b048
Deleted: sha256:26be88e10399b90d5911e69875981c67d1cd48d97e6dc23af16fa5d264da5555
Deleted: sha256:41e44c9bab050fac6510939f3b948a5a9039870ce198e27a642f848e7b782376
Deleted: sha256:161f1540f5134759265989a0badad3d1f72eff3805bb3d0ce8ad77180dbb1828
Deleted: sha256:318d21dbadbfa9cce3896e1102403d56c57281da2b3364435f31c61b93f967de
Deleted: sha256:5f2687be1ea19b5abf776c27f5ddf9809a34ed8237cacea283547e64bb0c7613
Deleted: sha256:350d77a812aff27cdf667b02038d0e46e2669e0703e1791aa6de198137d686c9
Deleted: sha256:ae939b3a4861923fc3bedc1d457ba8c5ad27de76c7f81fff99a2b4e2d733884d
Deleted: sha256:04b3eed7c6b90fff8493ecf467c66dd10c9b5eb84926d69a33fd77c44af4383f
Deleted: sha256:8106b6d1cf3f361e0b993b0984da141cf996e40a49c2c35201fb77b93957657f
Deleted: sha256:d7494f0e6fb245841bbffd027f4eec1bca1ab3ec39de9d31c742f28e4fcf48e2
Deleted: sha256:339cd5f8e6836bd34be49cfd4a99e16376467ea1d04f337a42519ee7dc2c1c7a
Deleted: sha256:06ae0c7449f1f4a043888064041da31bc3219b6a9b3d8c9ef4e5679edf7591f0
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-143119
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a12ca576db812f09971572da40d68cee4855b559664ce411f2c248d3bf1ee7be
Associated tags:
- 20230403-143119
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-143119
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-143119].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a12ca576db812f09971572da40d68cee4855b559664ce411f2c248d3bf1ee7be].
$ rm -rf /tmp/tmp.sTRZQ60PgJ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5feea74dbc175c6c47ce3174bb0b40ed1197e1a8b80fd802af26391f580597a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5feea74dbc175c6c47ce3174bb0b40ed1197e1a8b80fd802af26391f580597a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5feea74dbc175c6c47ce3174bb0b40ed1197e1a8b80fd802af26391f580597a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5feea74dbc175c6c47ce3174bb0b40ed1197e1a8b80fd802af26391f580597a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5feea74dbc175c6c47ce3174bb0b40ed1197e1a8b80fd802af26391f580597a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b5feea74dbc175c6c47ce3174bb0b40ed1197e1a8b80fd802af26391f580597a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a91cd18db2e27ccb158f98290d1f77962777e29c680a29a8519a4aaca0743cfa
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a91cd18db2e27ccb158f98290d1f77962777e29c680a29a8519a4aaca0743cfa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a91cd18db2e27ccb158f98290d1f77962777e29c680a29a8519a4aaca0743cfa])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a91cd18db2e27ccb158f98290d1f77962777e29c680a29a8519a4aaca0743cfa
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a91cd18db2e27ccb158f98290d1f77962777e29c680a29a8519a4aaca0743cfa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a91cd18db2e27ccb158f98290d1f77962777e29c680a29a8519a4aaca0743cfa].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 24322.
Stopping expansion service pid: 24323.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 12s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/vn3uqsouv7vus
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1480
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1480/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-083104",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403082041",
"environmentId": "FxarBOiZDGbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-083104"
}
]
},
"name": "go-testxlang_partition-633",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/03 09:17:05 Submitted job: 2023-04-03_02_17_05-3546848943627456010
2023/04/03 09:17:05 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-03_02_17_05-3546848943627456010?project=apache-beam-testing
2023/04/03 09:17:05 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-03_02_17_05-3546848943627456010
2023/04/03 09:17:05 Job state: JOB_STATE_PENDING ...
2023/04/03 09:17:35 Job still running ...
2023/04/03 09:18:05 Job still running ...
2023/04/03 09:18:35 Job still running ...
2023/04/03 09:19:05 Job still running ...
2023/04/03 09:19:35 Job still running ...
2023/04/03 09:20:06 Job still running ...
2023/04/03 09:20:36 Job still running ...
2023/04/03 09:21:06 Job still running ...
2023/04/03 09:21:36 Job still running ...
2023/04/03 09:22:06 Job still running ...
2023/04/03 09:22:36 Job still running ...
2023/04/03 09:23:06 Job still running ...
2023/04/03 09:23:36 Job still running ...
2023/04/03 09:24:06 Job still running ...
2023/04/03 09:24:36 Job still running ...
2023/04/03 09:25:06 Job still running ...
2023/04/03 09:25:36 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-03_02_17_05-3546848943627456010 failed
--- FAIL: TestXLang_Partition (552.00s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3269.908s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680510700204878671
--- FAIL: TestBigQueryIO_BasicWriteRead (4.38s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46827 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KROfmQYHnL" is_bounded:BOUNDED windowing_strategy_id:"w0@KROfmQYHnL"}} windowing_strategies:{key:"w0@KROfmQYHnL" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KROfmQYHnL" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KROfmQYHnL" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KROfmQYHnL" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680510700204878671\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KROfmQYHnL"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46827 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KROfmQYHnL" is_bounded:BOUNDED windowing_strategy_id:"w0@KROfmQYHnL"}} windowing_strategies:{key:"w0@KROfmQYHnL" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KROfmQYHnL" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KROfmQYHnL" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KROfmQYHnL" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680510700204878671\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KROfmQYHnL"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf6f100, 0xc00050c9c0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf6f100, 0xc00050c9c0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000489680?, 0xc0004ae960?}, {0x113b5e2, 0x39}, {0xc0000f20c0?, 0x1049ee0?, 0xc0004b2d50?}, {0xc000480f50, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000489620?, 0xc0004ae960?}, {0xc00004efc0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0xe7b460?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000480f50, 0xf}, {0xc00004efc0, 0x52}, {0xebc8a0, 0xc0004ea270})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00035eb60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00035eb60, 0x116da28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.408s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.022s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:46dc88c4a01857bcfaa0cf78a3ab301f94d59fde95ac5c7f6c547040abf17438
Associated tags:
- 20230403-083104
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-083104
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-083104].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:46dc88c4a01857bcfaa0cf78a3ab301f94d59fde95ac5c7f6c547040abf17438].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c58ab10ab211cd39b4b360dbd52fc40e9318be2f74a4a8f9b53720f63f7cd02a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c58ab10ab211cd39b4b360dbd52fc40e9318be2f74a4a8f9b53720f63f7cd02a])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c58ab10ab211cd39b4b360dbd52fc40e9318be2f74a4a8f9b53720f63f7cd02a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c58ab10ab211cd39b4b360dbd52fc40e9318be2f74a4a8f9b53720f63f7cd02a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5c49cca5ca914e6bd7f8f2572b41bd549f929af5a29ea5b6565cd308bc32c9a8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5c49cca5ca914e6bd7f8f2572b41bd549f929af5a29ea5b6565cd308bc32c9a8])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5c49cca5ca914e6bd7f8f2572b41bd549f929af5a29ea5b6565cd308bc32c9a8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5c49cca5ca914e6bd7f8f2572b41bd549f929af5a29ea5b6565cd308bc32c9a8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 50s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/vfndjkrqgxgim
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1479
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1479/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-023100",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403022041",
"environmentId": "XhSGAhpUkpbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-023100"
}
]
},
"name": "go-testxlang_partition-212",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/03 03:16:22 Submitted job: 2023-04-02_20_16_22-5501409846247245268
2023/04/03 03:16:22 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-02_20_16_22-5501409846247245268?project=apache-beam-testing
2023/04/03 03:16:22 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-02_20_16_22-5501409846247245268
2023/04/03 03:16:22 Job state: JOB_STATE_PENDING ...
2023/04/03 03:16:52 Job still running ...
2023/04/03 03:17:22 Job still running ...
2023/04/03 03:17:52 Job still running ...
2023/04/03 03:18:23 Job still running ...
2023/04/03 03:18:53 Job still running ...
2023/04/03 03:19:23 Job still running ...
2023/04/03 03:19:53 Job still running ...
2023/04/03 03:20:23 Job still running ...
2023/04/03 03:20:53 Job still running ...
2023/04/03 03:21:23 Job still running ...
2023/04/03 03:21:53 Job still running ...
2023/04/03 03:22:23 Job still running ...
2023/04/03 03:22:53 Job still running ...
2023/04/03 03:23:23 Job still running ...
2023/04/03 03:23:53 Job still running ...
2023/04/03 03:24:23 Job still running ...
2023/04/03 03:24:53 Job still running ...
2023/04/03 03:25:23 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-02_20_16_22-5501409846247245268 failed
--- FAIL: TestXLang_Partition (579.70s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3262.804s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680489094355954449
--- FAIL: TestBigQueryIO_BasicWriteRead (4.39s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33605 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@THPAwJxIOd" is_bounded:BOUNDED windowing_strategy_id:"w0@THPAwJxIOd"}} windowing_strategies:{key:"w0@THPAwJxIOd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@THPAwJxIOd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@THPAwJxIOd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@THPAwJxIOd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680489094355954449\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"THPAwJxIOd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33605 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@THPAwJxIOd" is_bounded:BOUNDED windowing_strategy_id:"w0@THPAwJxIOd"}} windowing_strategies:{key:"w0@THPAwJxIOd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@THPAwJxIOd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@THPAwJxIOd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@THPAwJxIOd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680489094355954449\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"THPAwJxIOd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 20 [running]:
testing.tRunner.func1.2({0xf6f100, 0xc00040c880})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf6f100, 0xc00040c880})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a8340?, 0xc0000be320?}, {0x113b5e2, 0x39}, {0xc0001560c0?, 0x1049ee0?, 0xc0000c07b0?}, {0xc000498ea0, 0xf}, 0xc0004e9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a82e0?, 0xc0000be320?}, {0xc00004e300, 0x52}, {0x1?}, {0xc0004e9ea8, 0x2, 0xe7b460?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000498ea0, 0xf}, {0xc00004e300, 0x52}, {0xebc8a0, 0xc000044e00})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031d6c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031d6c0, 0x116da28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.416s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.025s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.021s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5b0989acccd0372b090fa2531417d3f3e3ea696a19946502134a8edd2f15af25
Associated tags:
- 20230403-023100
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-023100
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230403-023100].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5b0989acccd0372b090fa2531417d3f3e3ea696a19946502134a8edd2f15af25].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7875a68fe2050c1e3be5ab74b89f9ba3ed62770778719360ef68a231323dcdcf]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230403022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7875a68fe2050c1e3be5ab74b89f9ba3ed62770778719360ef68a231323dcdcf])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7875a68fe2050c1e3be5ab74b89f9ba3ed62770778719360ef68a231323dcdcf
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7875a68fe2050c1e3be5ab74b89f9ba3ed62770778719360ef68a231323dcdcf].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b00c7352822ed18137574a6e550cc1b72bdb62fd5de211cdbeab08d3e77ba783]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230403022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b00c7352822ed18137574a6e550cc1b72bdb62fd5de211cdbeab08d3e77ba783])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b00c7352822ed18137574a6e550cc1b72bdb62fd5de211cdbeab08d3e77ba783
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b00c7352822ed18137574a6e550cc1b72bdb62fd5de211cdbeab08d3e77ba783].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 36s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/vfjorl6wliva6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1478
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1478/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-203058",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402202031",
"environmentId": "xjkDywEKfqbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-203058"
}
]
},
"name": "go-testxlang_partition-444",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/02 21:16:58 Submitted job: 2023-04-02_14_16_57-2903159550759474034
2023/04/02 21:16:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-02_14_16_57-2903159550759474034?project=apache-beam-testing
2023/04/02 21:16:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-02_14_16_57-2903159550759474034
2023/04/02 21:16:58 Job state: JOB_STATE_PENDING ...
2023/04/02 21:17:28 Job still running ...
2023/04/02 21:17:58 Job still running ...
2023/04/02 21:18:28 Job still running ...
2023/04/02 21:18:58 Job still running ...
2023/04/02 21:19:28 Job still running ...
2023/04/02 21:19:58 Job still running ...
2023/04/02 21:20:28 Job still running ...
2023/04/02 21:20:58 Job still running ...
2023/04/02 21:21:28 Job still running ...
2023/04/02 21:21:58 Job still running ...
2023/04/02 21:22:28 Job still running ...
2023/04/02 21:22:58 Job still running ...
2023/04/02 21:23:28 Job still running ...
2023/04/02 21:23:58 Job still running ...
2023/04/02 21:24:28 Job still running ...
2023/04/02 21:24:58 Job still running ...
2023/04/02 21:25:28 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-02_14_16_57-2903159550759474034 failed
--- FAIL: TestXLang_Partition (549.82s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3262.236s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680467504682200721
--- FAIL: TestBigQueryIO_BasicWriteRead (4.49s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33689 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hEoQTdNQPt" is_bounded:BOUNDED windowing_strategy_id:"w0@hEoQTdNQPt"}} windowing_strategies:{key:"w0@hEoQTdNQPt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hEoQTdNQPt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hEoQTdNQPt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hEoQTdNQPt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680467504682200721\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hEoQTdNQPt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33689 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@hEoQTdNQPt" is_bounded:BOUNDED windowing_strategy_id:"w0@hEoQTdNQPt"}} windowing_strategies:{key:"w0@hEoQTdNQPt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@hEoQTdNQPt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@hEoQTdNQPt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@hEoQTdNQPt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680467504682200721\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"hEoQTdNQPt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 20 [running]:
testing.tRunner.func1.2({0xf6f100, 0xc00049dac0})
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1526 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1529 +0x39f
panic({0xf6f100, 0xc00049dac0})
/home/jenkins/sdk/go1.20.2/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a80a0?, 0xc0004c4500?}, {0x113b5e2, 0x39}, {0xc0001560c0?, 0x1049ee0?, 0xc0004c80f0?}, {0xc000498ea0, 0xf}, 0xc0000d5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a8040?, 0xc0004c4500?}, {0xc00004e300, 0x52}, {0x1?}, {0xc0000d5ea8, 0x2, 0xe7b460?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000498ea0, 0xf}, {0xc00004e300, 0x52}, {0xebc8a0, 0xc0000440a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x205
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00031d6c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00031d6c0, 0x116da28)
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.20.2/src/testing/testing.go:1629 +0x3ea
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.509s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.026s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.025s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.021s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e116583aadfeb139bb01ab8711e34e806c57624b1229d7e6b695d67286e08f73
Associated tags:
- 20230402-203058
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-203058
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-203058].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e116583aadfeb139bb01ab8711e34e806c57624b1229d7e6b695d67286e08f73].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1fa12fb0530fe27c668e8e84dcf11197fa0c69411491a652d82d5341a68e2b40]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1fa12fb0530fe27c668e8e84dcf11197fa0c69411491a652d82d5341a68e2b40])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1fa12fb0530fe27c668e8e84dcf11197fa0c69411491a652d82d5341a68e2b40
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1fa12fb0530fe27c668e8e84dcf11197fa0c69411491a652d82d5341a68e2b40].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e1d131b1968293c9f2945e64ba3b8602217ebf0d5f539c6f582b4e38d626f866]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e1d131b1968293c9f2945e64ba3b8602217ebf0d5f539c6f582b4e38d626f866])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e1d131b1968293c9f2945e64ba3b8602217ebf0d5f539c6f582b4e38d626f866
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e1d131b1968293c9f2945e64ba3b8602217ebf0d5f539c6f582b4e38d626f866].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 52s
232 actionable tasks: 179 executed, 43 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/znvpbaewy47gy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1477
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1477/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402142121",
"environmentId": "pYNSBylHWVbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-143245"
}
]
},
"name": "go-testxlang_partition-429",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/02 15:17:43 Submitted job: 2023-04-02_08_17_42-3173872031369391043
2023/04/02 15:17:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-02_08_17_42-3173872031369391043?project=apache-beam-testing
2023/04/02 15:17:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-02_08_17_42-3173872031369391043
2023/04/02 15:17:43 Job state: JOB_STATE_PENDING ...
2023/04/02 15:18:13 Job still running ...
2023/04/02 15:18:43 Job still running ...
2023/04/02 15:19:13 Job still running ...
2023/04/02 15:19:43 Job still running ...
2023/04/02 15:20:13 Job still running ...
2023/04/02 15:20:43 Job still running ...
2023/04/02 15:21:13 Job still running ...
2023/04/02 15:21:43 Job still running ...
2023/04/02 15:22:13 Job still running ...
2023/04/02 15:22:43 Job still running ...
2023/04/02 15:23:14 Job still running ...
2023/04/02 15:23:44 Job still running ...
2023/04/02 15:24:14 Job still running ...
2023/04/02 15:24:44 Job still running ...
2023/04/02 15:25:14 Job still running ...
2023/04/02 15:25:44 Job still running ...
2023/04/02 15:26:14 Job still running ...
2023/04/02 15:26:44 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-02_08_17_42-3173872031369391043 failed
--- FAIL: TestXLang_Partition (580.12s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3235.051s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680446002756620208
--- FAIL: TestBigQueryIO_BasicWriteRead (4.37s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35643 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@faTtDCEAVc" is_bounded:BOUNDED windowing_strategy_id:"w0@faTtDCEAVc"}} windowing_strategies:{key:"w0@faTtDCEAVc" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@faTtDCEAVc" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@faTtDCEAVc" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@faTtDCEAVc" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680446002756620208\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"faTtDCEAVc"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35643 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@faTtDCEAVc" is_bounded:BOUNDED windowing_strategy_id:"w0@faTtDCEAVc"}} windowing_strategies:{key:"w0@faTtDCEAVc" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@faTtDCEAVc" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@faTtDCEAVc" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@faTtDCEAVc" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680446002756620208\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"faTtDCEAVc"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc000326c80})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc000326c80})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000118460?, 0xc0003f6050?}, {0x1137c73, 0x39}, {0xc0000f00c0?, 0xa9d780?, 0x1?}, {0xc000700c60, 0xf}, 0xc000343d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000118400?, 0xc0003f6050?}, {0xc0004644e0, 0x52}, {0x1?}, {0xc000343ea8, 0x2, 0xe79320?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000700c60, 0xf}, {0xc0004644e0, 0x52}, {0xeba2e0, 0xc00011e0f8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000589040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000589040, 0x1169b88)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.404s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-143245
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-143245
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ccd3054aa38f1631ce74b4005a7ef8d729d0fe37f3e31a3cd37f7ca31aab581b
Deleted: sha256:97ce94a78b4466a99a1d85cfbfb69d14b6ecbb29219d2fa424b0add9cdaf5359
Deleted: sha256:e61ef981c983b506aa77ac5473c2ead86a00e0a16d2b8afe5713285c08fdbcc4
Deleted: sha256:19bd5352556c5f71107ac28eb15009b355f5cfcd363a9310edffbf9423bf4f3e
Deleted: sha256:c1bde326f0e913a0c40419bbcac012ad5194b6325f8ee452d810ec6949c4ba10
Deleted: sha256:81552721ca55ef86da5a05f075adc8ed514603f4736f4240a852a9952483d005
Deleted: sha256:95adc1798302e9d3246d3c1b4fd48528994d199a1b2e361568251abd30b0b2a7
Deleted: sha256:dbbd544314b9611847f35428ab3801c39619e7918b9297e1c5f11cfd501f8072
Deleted: sha256:258728eebd8b534bdf7847a51562adb5a02f50a23c6b66dca55bf2a0d1491321
Deleted: sha256:9188ff8235511bc259339a02a6f178dc309f83c9f060f0e0766e40bd7ce831c9
Deleted: sha256:28e6d946e6a09f9966cb57978e725fbf7af0abed51d128848cad9cb462f67cf9
Deleted: sha256:57b422b6376251862925e99cb31d21741ab0502a6f8f85085e5d80fa21078eee
Deleted: sha256:4bd302b7e8bf4e7ed3a4c0b43e21a5130d47b7840a6e2cb4888f945ab103d048
Deleted: sha256:ca2080282594cc2fbc1bc04373c78356c6116e9d6eb6b118c5b497b9625e1879
Deleted: sha256:92ed20dce012dd2e9aa7dd214008d9034bbc0e5b8601da5911cd15c275886a8d
Deleted: sha256:17089ad9fae7fd2de901f83aa5fe4b468d21cf0672a04499e6db0830b320c203
Deleted: sha256:ff14b49f6cff569b87ccc9704ec35eeaf156436bbc2bf5d16386575821775862
Deleted: sha256:89a32f21a6b73fd83ad6fcba2889cdc44bdc9b96f97e361235f3f5f24447c03f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-143245
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ccd3054aa38f1631ce74b4005a7ef8d729d0fe37f3e31a3cd37f7ca31aab581b
Associated tags:
- 20230402-143245
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-143245
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-143245].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ccd3054aa38f1631ce74b4005a7ef8d729d0fe37f3e31a3cd37f7ca31aab581b].
$ rm -rf /tmp/tmp.Y9P5K6vZ7u
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402142121
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5f69a979a04692636ab1612c48a74f618e78c2ffebe741d9884704cb8e2d2b33
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402142121]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5f69a979a04692636ab1612c48a74f618e78c2ffebe741d9884704cb8e2d2b33]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402142121] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5f69a979a04692636ab1612c48a74f618e78c2ffebe741d9884704cb8e2d2b33])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5f69a979a04692636ab1612c48a74f618e78c2ffebe741d9884704cb8e2d2b33
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5f69a979a04692636ab1612c48a74f618e78c2ffebe741d9884704cb8e2d2b33
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5f69a979a04692636ab1612c48a74f618e78c2ffebe741d9884704cb8e2d2b33].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402142121
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fcb8764731b6bb223fefc2aba1a99ebc2b4a6496bade551ff8b1d960eddeb8ba
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402142121]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fcb8764731b6bb223fefc2aba1a99ebc2b4a6496bade551ff8b1d960eddeb8ba]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402142121] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fcb8764731b6bb223fefc2aba1a99ebc2b4a6496bade551ff8b1d960eddeb8ba])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fcb8764731b6bb223fefc2aba1a99ebc2b4a6496bade551ff8b1d960eddeb8ba
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fcb8764731b6bb223fefc2aba1a99ebc2b4a6496bade551ff8b1d960eddeb8ba
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fcb8764731b6bb223fefc2aba1a99ebc2b4a6496bade551ff8b1d960eddeb8ba].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3491419.
Stopping expansion service pid: 3491421.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 51s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/7zdbghc67euns
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1476
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1476/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #26006: Google Cloud libraries BOM 26.11.0
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-083116",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402082040",
"environmentId": "uBAwxwLZApbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-083116"
}
]
},
"name": "go-testxlang_partition-111",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/02 09:16:47 Submitted job: 2023-04-02_02_16_46-4512997717796523210
2023/04/02 09:16:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-02_02_16_46-4512997717796523210?project=apache-beam-testing
2023/04/02 09:16:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-02_02_16_46-4512997717796523210
2023/04/02 09:16:47 Job state: JOB_STATE_PENDING ...
2023/04/02 09:17:17 Job still running ...
2023/04/02 09:17:47 Job still running ...
2023/04/02 09:18:17 Job still running ...
2023/04/02 09:18:47 Job still running ...
2023/04/02 09:19:17 Job still running ...
2023/04/02 09:19:47 Job still running ...
2023/04/02 09:20:17 Job still running ...
2023/04/02 09:20:47 Job still running ...
2023/04/02 09:21:17 Job still running ...
2023/04/02 09:21:47 Job still running ...
2023/04/02 09:22:17 Job still running ...
2023/04/02 09:22:47 Job still running ...
2023/04/02 09:23:17 Job still running ...
2023/04/02 09:23:48 Job still running ...
2023/04/02 09:24:18 Job still running ...
2023/04/02 09:24:48 Job still running ...
2023/04/02 09:25:18 Job still running ...
2023/04/02 09:25:48 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-02_02_16_46-4512997717796523210 failed
--- FAIL: TestXLang_Partition (580.29s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3265.773s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680424315743069679
--- FAIL: TestBigQueryIO_BasicWriteRead (4.40s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35391 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZIrrCJWHar" is_bounded:BOUNDED windowing_strategy_id:"w0@ZIrrCJWHar"}} windowing_strategies:{key:"w0@ZIrrCJWHar" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZIrrCJWHar" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZIrrCJWHar" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZIrrCJWHar" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680424315743069679\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZIrrCJWHar"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35391 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZIrrCJWHar" is_bounded:BOUNDED windowing_strategy_id:"w0@ZIrrCJWHar"}} windowing_strategies:{key:"w0@ZIrrCJWHar" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZIrrCJWHar" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZIrrCJWHar" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZIrrCJWHar" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680424315743069679\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZIrrCJWHar"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 41 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc000121400})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc000121400})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a6b80?, 0xc0000bc280?}, {0x1137c73, 0x39}, {0xc0000f00c0?, 0xa9d780?, 0x1?}, {0xc0003f6f60, 0xf}, 0xc0005c3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a6b20?, 0xc0000bc280?}, {0xc00059c360, 0x52}, {0x1?}, {0xc0005c3ea8, 0x2, 0x7fcc1d7a0448?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003f6f60, 0xf}, {0xc00059c360, 0x52}, {0xeba2e0, 0xc0000423b0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00046ba00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00046ba00, 0x1169b88)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.434s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:24538f18a45d0ff174bd01e64118b3d66c2402579ce51472bff1bf6e34274851
Associated tags:
- 20230402-083116
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-083116
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-083116].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:24538f18a45d0ff174bd01e64118b3d66c2402579ce51472bff1bf6e34274851].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4e0cf1f07835305d895e32db42a34e55f9f223b12ec9e1ffa49f5b2db07ef90]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4e0cf1f07835305d895e32db42a34e55f9f223b12ec9e1ffa49f5b2db07ef90])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4e0cf1f07835305d895e32db42a34e55f9f223b12ec9e1ffa49f5b2db07ef90
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a4e0cf1f07835305d895e32db42a34e55f9f223b12ec9e1ffa49f5b2db07ef90].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a380a2bd55840e8f8b729d9e163145266b903a2b1d807ad193209100f05289dc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a380a2bd55840e8f8b729d9e163145266b903a2b1d807ad193209100f05289dc])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a380a2bd55840e8f8b729d9e163145266b903a2b1d807ad193209100f05289dc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a380a2bd55840e8f8b729d9e163145266b903a2b1d807ad193209100f05289dc].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 4s
232 actionable tasks: 167 executed, 55 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/pfucl6yftdoi4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1475
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1475/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402022041",
"environmentId": "FmisrRHjYqbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-023108"
}
]
},
"name": "go-testxlang_partition-294",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/02 03:17:02 Submitted job: 2023-04-01_20_17_02-7769351591220674676
2023/04/02 03:17:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-01_20_17_02-7769351591220674676?project=apache-beam-testing
2023/04/02 03:17:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-01_20_17_02-7769351591220674676
2023/04/02 03:17:03 Job state: JOB_STATE_PENDING ...
2023/04/02 03:17:33 Job still running ...
2023/04/02 03:18:03 Job still running ...
2023/04/02 03:18:33 Job still running ...
2023/04/02 03:19:03 Job still running ...
2023/04/02 03:19:33 Job still running ...
2023/04/02 03:20:03 Job still running ...
2023/04/02 03:20:33 Job still running ...
2023/04/02 03:21:03 Job still running ...
2023/04/02 03:21:33 Job still running ...
2023/04/02 03:22:03 Job still running ...
2023/04/02 03:22:33 Job still running ...
2023/04/02 03:23:03 Job still running ...
2023/04/02 03:23:34 Job still running ...
2023/04/02 03:24:04 Job still running ...
2023/04/02 03:24:34 Job still running ...
2023/04/02 03:25:04 Job still running ...
2023/04/02 03:25:34 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-01_20_17_02-7769351591220674676 failed
--- FAIL: TestXLang_Partition (550.10s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3234.682s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680402733047438358
--- FAIL: TestBigQueryIO_BasicWriteRead (4.50s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39199 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ncEZhUNBCg" is_bounded:BOUNDED windowing_strategy_id:"w0@ncEZhUNBCg"}} windowing_strategies:{key:"w0@ncEZhUNBCg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ncEZhUNBCg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ncEZhUNBCg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ncEZhUNBCg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680402733047438358\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ncEZhUNBCg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:39199 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ncEZhUNBCg" is_bounded:BOUNDED windowing_strategy_id:"w0@ncEZhUNBCg"}} windowing_strategies:{key:"w0@ncEZhUNBCg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ncEZhUNBCg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ncEZhUNBCg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ncEZhUNBCg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680402733047438358\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ncEZhUNBCg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc000551340})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc000551340})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000590b60?, 0xc000139950?}, {0x1137c73, 0x39}, {0xc00015a0c0?, 0xa9d780?, 0x1?}, {0xc000042cd0, 0xf}, 0xc0005c1d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000590b00?, 0xc000139950?}, {0xc0004663c0, 0x52}, {0x1?}, {0xc0005c1ea8, 0x2, 0x7f68a7b7e448?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000042cd0, 0xf}, {0xc0004663c0, 0x52}, {0xeba2e0, 0xc000043fe0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000ccea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000ccea0, 0x1169b88)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.535s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.033s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-023108
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-023108
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c8f25a8b0e32a90e67c7e8913b9553a147416a328b8e550774d88fa5cad2168e
Deleted: sha256:b1fbcd7d575178d164535e8b69bdeaebecebeb44f51e9ca01be4aeebb42e25d8
Deleted: sha256:c3ed0e6abc61f9c7694026c943b52f9e8b2c67c7d4cd96e956830b97eab2936c
Deleted: sha256:a309ce4515f81093f76197f2f5170f9bf7a84cdee384adef013962b5d99cab19
Deleted: sha256:c86fd7ddb613fedf608a19f0fd5dc73b8e2501e21d18c2339283ef4b8a26e7cf
Deleted: sha256:db2db565d4ada5042f3f66a1f3822fa8da1266c164124ce67ce313c0cac2bf9a
Deleted: sha256:d0084f5161a416c77a4909cec1a616c55998d4c95facac6394bf033142100f7f
Deleted: sha256:818fd7ccbffad4c509931b3e32ce01945640fdad968ddec95b92278469061db0
Deleted: sha256:0548ff55a9de12a12297c007c08f4aad8aa264167dee44245d06bc401a6f550e
Deleted: sha256:2822ce18fc5ed7dc837ff774ac310d9aa16c0f91c1b316f8b2aa0faf9be3f883
Deleted: sha256:11ee1c457cf0bbce98409b01a67b98246b1954b3e2f7a48bd9c4ff06cdfc3b6f
Deleted: sha256:88408a925d234b7d0c5accec71a81fa7108b2b0762348c72ec0014f02651cd24
Deleted: sha256:92a8ec70763cda53b891e14fe2706a5e9198513a7a2104c5cd051e8512a583dd
Deleted: sha256:7abd2d268b822ab8272e82485f139420fb50a29255eef3a22f885b365b964261
Deleted: sha256:f8b3358780c3c8a83cb2e80740c529eed748f175e0846a51777efdf93201f247
Deleted: sha256:c9ad8071adaf6838524a863bbe7feb48d04b9a81bfa56f626ab0e219e52d055f
Deleted: sha256:fde4d840fda7e6e193703ef29fa178467cb64d1e8fde13bc9dd972de448990aa
Deleted: sha256:81c00f1feca62043f1d95d99df6b968c5067ac4f4887eeac6da4145c9e4d19d4
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-023108
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c8f25a8b0e32a90e67c7e8913b9553a147416a328b8e550774d88fa5cad2168e
Associated tags:
- 20230402-023108
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-023108
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230402-023108].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:c8f25a8b0e32a90e67c7e8913b9553a147416a328b8e550774d88fa5cad2168e].
$ rm -rf /tmp/tmp.uBA735yOaI
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:449097a0d2a0700e62847bfc425e21ceaeec1dc40c751695af795ce81b478229
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:449097a0d2a0700e62847bfc425e21ceaeec1dc40c751695af795ce81b478229]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230402022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:449097a0d2a0700e62847bfc425e21ceaeec1dc40c751695af795ce81b478229])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:449097a0d2a0700e62847bfc425e21ceaeec1dc40c751695af795ce81b478229
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:449097a0d2a0700e62847bfc425e21ceaeec1dc40c751695af795ce81b478229
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:449097a0d2a0700e62847bfc425e21ceaeec1dc40c751695af795ce81b478229].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dadb57c4589c32a8a899511793d2aba97dbda8fe344170ecf71f2139264c783
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dadb57c4589c32a8a899511793d2aba97dbda8fe344170ecf71f2139264c783]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230402022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dadb57c4589c32a8a899511793d2aba97dbda8fe344170ecf71f2139264c783])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dadb57c4589c32a8a899511793d2aba97dbda8fe344170ecf71f2139264c783
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dadb57c4589c32a8a899511793d2aba97dbda8fe344170ecf71f2139264c783
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dadb57c4589c32a8a899511793d2aba97dbda8fe344170ecf71f2139264c783].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3126170.
Stopping expansion service pid: 3126171.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 46s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/4e7rtavqq3awy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1474
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1474/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401202041",
"environmentId": "RHbubNWDzFbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-203109"
}
]
},
"name": "go-testxlang_partition-492",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/01 21:17:41 Submitted job: 2023-04-01_14_17_40-246265791990687485
2023/04/01 21:17:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-01_14_17_40-246265791990687485?project=apache-beam-testing
2023/04/01 21:17:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-01_14_17_40-246265791990687485
2023/04/01 21:17:41 Job state: JOB_STATE_PENDING ...
2023/04/01 21:18:11 Job still running ...
2023/04/01 21:18:41 Job still running ...
2023/04/01 21:19:11 Job still running ...
2023/04/01 21:19:41 Job still running ...
2023/04/01 21:20:11 Job still running ...
2023/04/01 21:20:41 Job still running ...
2023/04/01 21:21:11 Job still running ...
2023/04/01 21:21:41 Job still running ...
2023/04/01 21:22:11 Job still running ...
2023/04/01 21:22:41 Job still running ...
2023/04/01 21:23:11 Job still running ...
2023/04/01 21:23:41 Job still running ...
2023/04/01 21:24:11 Job still running ...
2023/04/01 21:24:41 Job still running ...
2023/04/01 21:25:12 Job still running ...
2023/04/01 21:25:42 Job still running ...
2023/04/01 21:26:12 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-01_14_17_40-246265791990687485 failed
--- FAIL: TestXLang_Partition (551.07s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3297.733s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680381107982115478
--- FAIL: TestBigQueryIO_BasicWriteRead (4.68s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35985 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qTxyXhwkjt" is_bounded:BOUNDED windowing_strategy_id:"w0@qTxyXhwkjt"}} windowing_strategies:{key:"w0@qTxyXhwkjt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qTxyXhwkjt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qTxyXhwkjt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qTxyXhwkjt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680381107982115478\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qTxyXhwkjt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35985 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@qTxyXhwkjt" is_bounded:BOUNDED windowing_strategy_id:"w0@qTxyXhwkjt"}} windowing_strategies:{key:"w0@qTxyXhwkjt" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@qTxyXhwkjt" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qTxyXhwkjt" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@qTxyXhwkjt" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680381107982115478\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"qTxyXhwkjt"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 14 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc0005536c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc0005536c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001160c0?, 0xc0000bc280?}, {0x1137c73, 0x39}, {0xc0000f00c0?, 0xa9d780?, 0x1?}, {0xc0003ec2a0, 0xf}, 0xc0004c9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000116040?, 0xc0000bc280?}, {0xc000514300, 0x52}, {0x1?}, {0xc0004c9ea8, 0x2, 0xe79320?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003ec2a0, 0xf}, {0xc000514300, 0x52}, {0xeba2e0, 0xc000118008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003f64e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003f64e0, 0x1169b88)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.704s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-203109
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-203109
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ee4be04a60a4b730a9fed1ca539ed9552c33f747125b65d654c3e221202f1045
Deleted: sha256:e1bfb8695c0316d6675fd75ee9e3fdfed12a5370b8d1cd3356558fa9d7c01337
Deleted: sha256:44a18115f142bc37e25a70b6228fc67f18adce591c4ad83d61db587bf6effa66
Deleted: sha256:612c7887e4b410cff2647e8f7af3d7ea535c69507299abe5a5e43ae2969becfe
Deleted: sha256:71bf342e5523fe986bf4e25f5d593011d46f8aa983082dc96fd9f0a0248efa59
Deleted: sha256:15ec6be884968ec012017c4f986268a6ca6860e61e21373ae4b31c67a6f15c09
Deleted: sha256:246774bb492c2a15837c25ccbf489828cca6d553878c975f4527d83fd123d71f
Deleted: sha256:99efd0e0900398c806f047cd5ef9b6b85073fb6c20d936a1821ee8c9f982b651
Deleted: sha256:1208c8d77cfa032aa935c0df7e9b2b481c9a98fe6a5f9993a611a18c85b3d66c
Deleted: sha256:f32d6cdf3a2a6265b373599b76bc5ee1be1dd904cf0dcd5901d76036078df3dc
Deleted: sha256:bc462d8b7856ba26b4c91342b5a8cee3fdf4acb457b5322c13f956d8e22fc562
Deleted: sha256:26abb92d395f045d88a7d4b1718ae174cbd916507d1d6e26706f678a69120823
Deleted: sha256:7db4fb0e40a0decbc5ada51666f5adcc1c3f119520f68f2388cbf9b48b62f1c5
Deleted: sha256:5c2f55d3b1971fa3706c3dec97c175da888ef8fdadade60bf2f368f2862277eb
Deleted: sha256:cb35c612663457d4feba04bf633f7df6a20b28caff6013aa0713fb226c29465c
Deleted: sha256:d1a60f4f912ef19c93e85adf79f93c144e34b6e04c84ad9b928152848285c1f1
Deleted: sha256:88717894eddc1ca55d842233d3c1ad9d761f913fe8ff7798987a32ccbeaa9ebf
Deleted: sha256:9e1c741fdd0e34afc703fb34d0a95fb891e249e87d951fbedfb4cc6f6b5c31dc
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-203109
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ee4be04a60a4b730a9fed1ca539ed9552c33f747125b65d654c3e221202f1045
Associated tags:
- 20230401-203109
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-203109
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-203109].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ee4be04a60a4b730a9fed1ca539ed9552c33f747125b65d654c3e221202f1045].
$ rm -rf /tmp/tmp.bXtTlNfHK5
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401202041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73fe7338334064c16790342ea58c9699f08a8f41423bd1966cfc9a6e167068f7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73fe7338334064c16790342ea58c9699f08a8f41423bd1966cfc9a6e167068f7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73fe7338334064c16790342ea58c9699f08a8f41423bd1966cfc9a6e167068f7])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73fe7338334064c16790342ea58c9699f08a8f41423bd1966cfc9a6e167068f7
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73fe7338334064c16790342ea58c9699f08a8f41423bd1966cfc9a6e167068f7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73fe7338334064c16790342ea58c9699f08a8f41423bd1966cfc9a6e167068f7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401202041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:144c870f4f92b07b5aabef077f0000847ba65aedd1ff6bc07261dab1bab347d3
Deleted: sha256:89485b1a1326d4eecd6117a11bc4a2bdbeda61d302a7c2b0f3456c873ca252b7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:144c870f4f92b07b5aabef077f0000847ba65aedd1ff6bc07261dab1bab347d3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:144c870f4f92b07b5aabef077f0000847ba65aedd1ff6bc07261dab1bab347d3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:144c870f4f92b07b5aabef077f0000847ba65aedd1ff6bc07261dab1bab347d3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:144c870f4f92b07b5aabef077f0000847ba65aedd1ff6bc07261dab1bab347d3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:144c870f4f92b07b5aabef077f0000847ba65aedd1ff6bc07261dab1bab347d3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2942508.
Stopping expansion service pid: 2942509.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 25s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/zzm2rt7777erw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1473
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1473/display/redirect>
Changes:
------------------------------------------
[...truncated 1021.56 KB...]
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401142039",
"environmentId": "YGEkZqaauLbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.47.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-143059",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-143059"
}
]
},
"name": "go-testxlang_partition-28",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/01 15:16:26 Submitted job: 2023-04-01_08_16_26-14391715313346791616
2023/04/01 15:16:26 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-01_08_16_26-14391715313346791616?project=apache-beam-testing
2023/04/01 15:16:26 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-01_08_16_26-14391715313346791616
2023/04/01 15:16:26 Job state: JOB_STATE_PENDING ...
2023/04/01 15:16:56 Job still running ...
2023/04/01 15:17:26 Job still running ...
2023/04/01 15:17:57 Job still running ...
2023/04/01 15:18:27 Job still running ...
2023/04/01 15:18:57 Job still running ...
2023/04/01 15:19:27 Job still running ...
2023/04/01 15:19:57 Job still running ...
2023/04/01 15:20:27 Job still running ...
2023/04/01 15:20:57 Job still running ...
2023/04/01 15:21:27 Job still running ...
2023/04/01 15:21:57 Job still running ...
2023/04/01 15:22:27 Job still running ...
2023/04/01 15:22:57 Job still running ...
2023/04/01 15:23:27 Job still running ...
2023/04/01 15:23:57 Job still running ...
2023/04/01 15:24:27 Job still running ...
2023/04/01 15:24:57 Job still running ...
2023/04/01 15:25:27 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-01_08_16_26-14391715313346791616 failed
--- FAIL: TestXLang_Partition (580.97s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3267.363s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680359493819937482
--- FAIL: TestBigQueryIO_BasicWriteRead (4.35s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37227 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ntJZOHHUfU" is_bounded:BOUNDED windowing_strategy_id:"w0@ntJZOHHUfU"}} windowing_strategies:{key:"w0@ntJZOHHUfU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ntJZOHHUfU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ntJZOHHUfU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ntJZOHHUfU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680359493819937482\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ntJZOHHUfU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37227 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ntJZOHHUfU" is_bounded:BOUNDED windowing_strategy_id:"w0@ntJZOHHUfU"}} windowing_strategies:{key:"w0@ntJZOHHUfU" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ntJZOHHUfU" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ntJZOHHUfU" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ntJZOHHUfU" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680359493819937482\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ntJZOHHUfU"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 12 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc0000fe400})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc0000fe400})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000168fc0?, 0xc000138230?}, {0x1137c73, 0x39}, {0xc000438000?, 0xa9d780?, 0x1?}, {0xc000408e20, 0xf}, 0xc00002bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000168ee0?, 0xc000138230?}, {0xc00004c5a0, 0x52}, {0x1?}, {0xc00002bea8, 0x2, 0xe79320?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000408e20, 0xf}, {0xc00004c5a0, 0x52}, {0xeba2e0, 0xc000042248})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000417520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000417520, 0x1169b88)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.384s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.032s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fbffcdb46b52554b08e0ec40c4267261952cded85aca95c918449ad2ac9388bd
Associated tags:
- 20230401-143059
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-143059
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-143059].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fbffcdb46b52554b08e0ec40c4267261952cded85aca95c918449ad2ac9388bd].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:468bc87f03de78c71bc2f2958e5b9f8a081eeed6c20326b97987ab352951ace0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:468bc87f03de78c71bc2f2958e5b9f8a081eeed6c20326b97987ab352951ace0])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:468bc87f03de78c71bc2f2958e5b9f8a081eeed6c20326b97987ab352951ace0
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:468bc87f03de78c71bc2f2958e5b9f8a081eeed6c20326b97987ab352951ace0].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401142039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15380ed5463e016057d93f9d96f18630e464cd461e3591bdbf8cff9a296b1794]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401142039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15380ed5463e016057d93f9d96f18630e464cd461e3591bdbf8cff9a296b1794])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15380ed5463e016057d93f9d96f18630e464cd461e3591bdbf8cff9a296b1794
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15380ed5463e016057d93f9d96f18630e464cd461e3591bdbf8cff9a296b1794].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 43s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/eces2h7nj2ivg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1472
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1472/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-083044",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401082027",
"environmentId": "RxIGjWcuYCbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-083044"
}
]
},
"name": "go-testxlang_partition-969",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/01 09:17:46 Submitted job: 2023-04-01_02_17_46-16621673837502783300
2023/04/01 09:17:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-01_02_17_46-16621673837502783300?project=apache-beam-testing
2023/04/01 09:17:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-04-01_02_17_46-16621673837502783300
2023/04/01 09:17:47 Job state: JOB_STATE_PENDING ...
2023/04/01 09:18:17 Job still running ...
2023/04/01 09:18:47 Job still running ...
2023/04/01 09:19:17 Job still running ...
2023/04/01 09:19:47 Job still running ...
2023/04/01 09:20:17 Job still running ...
2023/04/01 09:20:47 Job still running ...
2023/04/01 09:21:17 Job still running ...
2023/04/01 09:21:47 Job still running ...
2023/04/01 09:22:17 Job still running ...
2023/04/01 09:22:47 Job still running ...
2023/04/01 09:23:17 Job still running ...
2023/04/01 09:23:47 Job still running ...
2023/04/01 09:24:17 Job still running ...
2023/04/01 09:24:47 Job still running ...
2023/04/01 09:25:17 Job still running ...
2023/04/01 09:25:47 Job still running ...
2023/04/01 09:26:17 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-04-01_02_17_46-16621673837502783300 failed
--- FAIL: TestXLang_Partition (549.93s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3326.224s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680337884672067493
--- FAIL: TestBigQueryIO_BasicWriteRead (4.50s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37017 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FDsABFXZMr" is_bounded:BOUNDED windowing_strategy_id:"w0@FDsABFXZMr"}} windowing_strategies:{key:"w0@FDsABFXZMr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FDsABFXZMr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FDsABFXZMr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FDsABFXZMr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680337884672067493\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FDsABFXZMr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37017 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FDsABFXZMr" is_bounded:BOUNDED windowing_strategy_id:"w0@FDsABFXZMr"}} windowing_strategies:{key:"w0@FDsABFXZMr" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FDsABFXZMr" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FDsABFXZMr" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FDsABFXZMr" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680337884672067493\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FDsABFXZMr"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 15 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc00011b6c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc00011b6c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001180e0?, 0xc0000bc280?}, {0x1137c73, 0x39}, {0xc0000f00c0?, 0xa9d780?, 0x1?}, {0xc0003eeb50, 0xf}, 0xc000535d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000118020?, 0xc0000bc280?}, {0xc0003fc300, 0x52}, {0x1?}, {0xc000535ea8, 0x2, 0xe79320?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003eeb50, 0xf}, {0xc0003fc300, 0x52}, {0xeba2e0, 0xc000110148})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000580b60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000580b60, 0x1169b88)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.534s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:762faaeafcf3abf94598ffe8c5b57dc60651cdbbc0064bc8c7f9ff75953dd29a
Associated tags:
- 20230401-083044
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-083044
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-083044].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:762faaeafcf3abf94598ffe8c5b57dc60651cdbbc0064bc8c7f9ff75953dd29a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401082027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cca1c19bf0e3ace3d49e633c004b00c5b171c66a91c987d8495fa4f7e1f40cac]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401082027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cca1c19bf0e3ace3d49e633c004b00c5b171c66a91c987d8495fa4f7e1f40cac])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cca1c19bf0e3ace3d49e633c004b00c5b171c66a91c987d8495fa4f7e1f40cac
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cca1c19bf0e3ace3d49e633c004b00c5b171c66a91c987d8495fa4f7e1f40cac].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401082027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74d2b734065dee565f82eef41c343c91030a132477f35218b86d758726ce18e8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401082027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74d2b734065dee565f82eef41c343c91030a132477f35218b86d758726ce18e8])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74d2b734065dee565f82eef41c343c91030a132477f35218b86d758726ce18e8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:74d2b734065dee565f82eef41c343c91030a132477f35218b86d758726ce18e8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 3s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/fiqcohpa4ja4s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1471
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1471/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401022030",
"environmentId": "lVofTyKXSUbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-023056"
}
]
},
"name": "go-testxlang_partition-750",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/04/01 03:17:02 Submitted job: 2023-03-31_20_17_01-15536349017889844599
2023/04/01 03:17:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-31_20_17_01-15536349017889844599?project=apache-beam-testing
2023/04/01 03:17:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-31_20_17_01-15536349017889844599
2023/04/01 03:17:02 Job state: JOB_STATE_PENDING ...
2023/04/01 03:17:32 Job still running ...
2023/04/01 03:18:02 Job still running ...
2023/04/01 03:18:32 Job still running ...
2023/04/01 03:19:02 Job still running ...
2023/04/01 03:19:32 Job still running ...
2023/04/01 03:20:02 Job still running ...
2023/04/01 03:20:32 Job still running ...
2023/04/01 03:21:02 Job still running ...
2023/04/01 03:21:32 Job still running ...
2023/04/01 03:22:02 Job still running ...
2023/04/01 03:22:32 Job still running ...
2023/04/01 03:23:02 Job still running ...
2023/04/01 03:23:32 Job still running ...
2023/04/01 03:24:02 Job still running ...
2023/04/01 03:24:32 Job still running ...
2023/04/01 03:25:02 Job still running ...
2023/04/01 03:25:33 Job still running ...
2023/04/01 03:26:03 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-31_20_17_01-15536349017889844599 failed
--- FAIL: TestXLang_Partition (580.34s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3297.591s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680316304224421828
--- FAIL: TestBigQueryIO_BasicWriteRead (5.41s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42371 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AMHjlqhAOC" is_bounded:BOUNDED windowing_strategy_id:"w0@AMHjlqhAOC"}} windowing_strategies:{key:"w0@AMHjlqhAOC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AMHjlqhAOC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AMHjlqhAOC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AMHjlqhAOC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680316304224421828\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AMHjlqhAOC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42371 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@AMHjlqhAOC" is_bounded:BOUNDED windowing_strategy_id:"w0@AMHjlqhAOC"}} windowing_strategies:{key:"w0@AMHjlqhAOC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@AMHjlqhAOC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@AMHjlqhAOC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@AMHjlqhAOC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680316304224421828\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"AMHjlqhAOC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 41 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc0003c7180})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc0003c7180})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001205c0?, 0xc0001b0230?}, {0x1137c73, 0x39}, {0xc0001d20c0?, 0xa9d780?, 0x1?}, {0xc0001a9650, 0xf}, 0xc00001bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000120560?, 0xc0001b0230?}, {0xc00004c480, 0x52}, {0x1?}, {0xc00001bea8, 0x2, 0x7fc2e7cd1448?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0001a9650, 0xf}, {0xc00004c480, 0x52}, {0xeba2e0, 0xc000042190})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103d40)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103d40, 0x1169b88)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.446s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.031s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-023056
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-023056
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5e416bc2927b6e986761f71088a88a292aae94c6e0f675f7b0b015c573e8f508
Deleted: sha256:3336f2d76185bce02bd7f859314cc664bfc2062c522571f2e21c1cf540903754
Deleted: sha256:c2da15843cd8b0f9a4afb725031bfe825c0d190827246b6dcf13653f28981843
Deleted: sha256:5350ebe0351ce42d88b3071f0a74d8d7c2626a03744ee6b318f73384a5ab18e9
Deleted: sha256:e3f0dfb943b9ff4404fef5cb94f0f5d5de508c6b3a78c57a44b42f2b5763c235
Deleted: sha256:2c4ace83738b54a0dba50e0d8302ff3141bbaa1ef0e0106f1cb1a44ff6b7be61
Deleted: sha256:53fe79acaecc659a1e31edb1ff70f113843fa06c2c3f08e2f49044b2feecca7a
Deleted: sha256:07920f95a6baec67dd6c1fcce02e2ddaf3475c6f5713cbd8f3b1570fd0d2d082
Deleted: sha256:b6f17efb6002a2e3643ee1692e1d4ce35ba89f43bc851788bbae10f2ba49de86
Deleted: sha256:54a7f303ded59c45f40b0eab7c8c667ecc0ee805577fc7a3983745085afd96f2
Deleted: sha256:c6a6b8948a753a003d532241d61f8f0b78277147c8ad7c0b2e0bf9e9fe7a2aff
Deleted: sha256:68a1f9b852776dfde4ae52e70f42d851689d764094c21c7128dc33705540d407
Deleted: sha256:b13e76080bd2522bf469cf0e55dac588d6f96ac7e36961078373bb473788cdc7
Deleted: sha256:886405c24eb893ef95e4f11b8f8f1486c1395617430d72f9f5b327431d00b0ce
Deleted: sha256:862294c2352f94ae9fea6f8d3944eff81149e1bf7b70b8500e0118f3d16463f7
Deleted: sha256:b9204e46ae9c633bec929df6f35de0a7252f03b1c3feea044bd64d49c32f8840
Deleted: sha256:a770c14f5b067e101b367b7d5351982606b77b376466d453a39aa42738025bed
Deleted: sha256:db6559908d924a38e3c5110f60cb4857cbe35328b5dcaadc9935ddf46812d102
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-023056
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5e416bc2927b6e986761f71088a88a292aae94c6e0f675f7b0b015c573e8f508
Associated tags:
- 20230401-023056
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-023056
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230401-023056].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:5e416bc2927b6e986761f71088a88a292aae94c6e0f675f7b0b015c573e8f508].
$ rm -rf /tmp/tmp.iy92Zy9r30
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401022030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c4ca67b638fde6ef925dd86eefc453eb99c0149191f2f75d86cbd5ddbc89c79
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401022030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c4ca67b638fde6ef925dd86eefc453eb99c0149191f2f75d86cbd5ddbc89c79]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230401022030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c4ca67b638fde6ef925dd86eefc453eb99c0149191f2f75d86cbd5ddbc89c79])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c4ca67b638fde6ef925dd86eefc453eb99c0149191f2f75d86cbd5ddbc89c79
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c4ca67b638fde6ef925dd86eefc453eb99c0149191f2f75d86cbd5ddbc89c79
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4c4ca67b638fde6ef925dd86eefc453eb99c0149191f2f75d86cbd5ddbc89c79].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401022030
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25890ddde3d17966bc2fedc64d24f91cb35dd5af3345699dae6f52800eed91cf
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401022030]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25890ddde3d17966bc2fedc64d24f91cb35dd5af3345699dae6f52800eed91cf]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230401022030] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25890ddde3d17966bc2fedc64d24f91cb35dd5af3345699dae6f52800eed91cf])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25890ddde3d17966bc2fedc64d24f91cb35dd5af3345699dae6f52800eed91cf
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25890ddde3d17966bc2fedc64d24f91cb35dd5af3345699dae6f52800eed91cf
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:25890ddde3d17966bc2fedc64d24f91cb35dd5af3345699dae6f52800eed91cf].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2408145.
Stopping expansion service pid: 2408146.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 29s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/g65t5kpulhd6u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1470
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1470/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331202059",
"environmentId": "vSfNRSSjBubeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-203206"
}
]
},
"name": "go-testxlang_partition-105",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/31 21:18:36 Submitted job: 2023-03-31_14_18_36-6649786612259679888
2023/03/31 21:18:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-31_14_18_36-6649786612259679888?project=apache-beam-testing
2023/03/31 21:18:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-31_14_18_36-6649786612259679888
2023/03/31 21:18:36 Job state: JOB_STATE_PENDING ...
2023/03/31 21:19:06 Job still running ...
2023/03/31 21:19:36 Job still running ...
2023/03/31 21:20:07 Job still running ...
2023/03/31 21:20:37 Job still running ...
2023/03/31 21:21:07 Job still running ...
2023/03/31 21:21:37 Job still running ...
2023/03/31 21:22:07 Job still running ...
2023/03/31 21:22:37 Job still running ...
2023/03/31 21:23:07 Job still running ...
2023/03/31 21:23:37 Job still running ...
2023/03/31 21:24:07 Job still running ...
2023/03/31 21:24:37 Job still running ...
2023/03/31 21:25:07 Job still running ...
2023/03/31 21:25:37 Job still running ...
2023/03/31 21:26:07 Job still running ...
2023/03/31 21:26:37 Job still running ...
2023/03/31 21:27:07 Job still running ...
2023/03/31 21:27:37 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-31_14_18_36-6649786612259679888 failed
--- FAIL: TestXLang_Partition (581.23s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3314.460s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680294776776692116
--- FAIL: TestBigQueryIO_BasicWriteRead (5.53s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33303 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@siQCISuVsw" is_bounded:BOUNDED windowing_strategy_id:"w0@siQCISuVsw"}} windowing_strategies:{key:"w0@siQCISuVsw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@siQCISuVsw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@siQCISuVsw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@siQCISuVsw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680294776776692116\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"siQCISuVsw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33303 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@siQCISuVsw" is_bounded:BOUNDED windowing_strategy_id:"w0@siQCISuVsw"}} windowing_strategies:{key:"w0@siQCISuVsw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@siQCISuVsw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@siQCISuVsw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@siQCISuVsw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680294776776692116\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"siQCISuVsw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 10 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc00017ad80})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc00017ad80})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000136340?, 0xc00040a050?}, {0x1137c31, 0x39}, {0xc0000ee0c0?, 0xa9d780?, 0x1?}, {0xc00011ac90, 0xf}, 0xc00054bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0001362e0?, 0xc00040a050?}, {0xc00004ca20, 0x52}, {0x1?}, {0xc00054bea8, 0x2, 0xe79320?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00011ac90, 0xf}, {0xc00004ca20, 0x52}, {0xeba2e0, 0xc0003fe0e8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006c29c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006c29c0, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.561s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.045s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-203206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-203206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2cd22ea984b72fe45a3a06e63b33b09470006154bde32e17420001341a58ef48
Deleted: sha256:81b33aa42a66e542b2f3282f3bf4aceea76c85748476f9832c4da0df4140c7f4
Deleted: sha256:21aff367cb2c75376a4ec9ffae26c93f17036013203a8a4d35769ec5ae3950bd
Deleted: sha256:191a20be860b44d26121432e8c42efe43191e0c59ddf5909ea34fb37856101c0
Deleted: sha256:ee77855052beeed334b41f823eae7ddaa8ba10af569f6598c904683d84076035
Deleted: sha256:5fece8a9d27b5c6ddd1f4f5ecac975916fdd85fa921191ae0d458bf5510c9ff9
Deleted: sha256:bb20b63fe6a4a37c5b6182fb9df4887d56db96793dd4b6b182a6860e02d563e3
Deleted: sha256:e12d1f27bc2c78b88575979142a7576a585950473eda6ba988ebae4fcaf2da47
Deleted: sha256:fddb5440a9a3e3b4588abbf5e8b2e9b10adea9ab1381f8752508c910ed750284
Deleted: sha256:4bdd0e4deaff1ef2505aec00fe8dd9a31514459247fcf8df5f1eddd783fa112e
Deleted: sha256:5ca4f2fa3d39399f076abeaae8b057a22d6c9067c9b7b7a23fa8503fdfa5f347
Deleted: sha256:353c838cc8bd11dcda3e485146cb40b14c72ee52230516994ca869dc679097d4
Deleted: sha256:403ecce9c37f84718ac600341c5b28259a482a6e5fb55989e180a704f22d217c
Deleted: sha256:6bfb1b20acf56db0851c1361de599f3f5c345647b3534f2ffc93ff1e04b55129
Deleted: sha256:174158ee468f60521deac2fc9b498bc8eb1e9d61bd163ab579eb85034d268905
Deleted: sha256:614f19e4e2eb63b9161faec079726eb22c78a0f3c38bb520b06a8be8265c7e08
Deleted: sha256:8aaf23bec761761e4939be50289d64edc37df9582d0ad7c5bc9eee174140ac27
Deleted: sha256:aa8206ea77ce865bbe919c8bf9ba73b03b9165e997db5009c9c2d7ab77436ddc
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-203206
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2cd22ea984b72fe45a3a06e63b33b09470006154bde32e17420001341a58ef48
Associated tags:
- 20230331-203206
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-203206
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-203206].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:2cd22ea984b72fe45a3a06e63b33b09470006154bde32e17420001341a58ef48].
$ rm -rf /tmp/tmp.zJaSlZ8caP
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331202059
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7daba2bfb50fde61811037cc0378abf48f39cc8e3625be8f5306d128ceb2faa2
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331202059]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7daba2bfb50fde61811037cc0378abf48f39cc8e3625be8f5306d128ceb2faa2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331202059] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7daba2bfb50fde61811037cc0378abf48f39cc8e3625be8f5306d128ceb2faa2])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7daba2bfb50fde61811037cc0378abf48f39cc8e3625be8f5306d128ceb2faa2
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7daba2bfb50fde61811037cc0378abf48f39cc8e3625be8f5306d128ceb2faa2
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7daba2bfb50fde61811037cc0378abf48f39cc8e3625be8f5306d128ceb2faa2].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331202059
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef71ce40e5af37d89f9e53e80dde19ee2a6a4172c6ee904cb02115c5239ee369
Deleted: sha256:a31de49416c0e3c62e80046135ebd6cbe9ad4abed81b97fd34a64abee79b6184
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331202059]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef71ce40e5af37d89f9e53e80dde19ee2a6a4172c6ee904cb02115c5239ee369]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331202059] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef71ce40e5af37d89f9e53e80dde19ee2a6a4172c6ee904cb02115c5239ee369])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef71ce40e5af37d89f9e53e80dde19ee2a6a4172c6ee904cb02115c5239ee369
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef71ce40e5af37d89f9e53e80dde19ee2a6a4172c6ee904cb02115c5239ee369
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef71ce40e5af37d89f9e53e80dde19ee2a6a4172c6ee904cb02115c5239ee369].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1711698.
Stopping expansion service pid: 1711699.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 58s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/3x7umijgesehe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1469
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1469/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331142038",
"environmentId": "ZDuIirgpAsbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-143103"
}
]
},
"name": "go-testxlang_partition-0",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/31 15:16:11 Submitted job: 2023-03-31_08_16_10-3156489466031653127
2023/03/31 15:16:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-31_08_16_10-3156489466031653127?project=apache-beam-testing
2023/03/31 15:16:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-31_08_16_10-3156489466031653127
2023/03/31 15:16:11 Job state: JOB_STATE_PENDING ...
2023/03/31 15:16:41 Job still running ...
2023/03/31 15:17:11 Job still running ...
2023/03/31 15:17:41 Job still running ...
2023/03/31 15:18:11 Job still running ...
2023/03/31 15:18:41 Job still running ...
2023/03/31 15:19:11 Job still running ...
2023/03/31 15:19:41 Job still running ...
2023/03/31 15:20:11 Job still running ...
2023/03/31 15:20:41 Job still running ...
2023/03/31 15:21:11 Job still running ...
2023/03/31 15:21:41 Job still running ...
2023/03/31 15:22:11 Job still running ...
2023/03/31 15:22:41 Job still running ...
2023/03/31 15:23:11 Job still running ...
2023/03/31 15:23:41 Job still running ...
2023/03/31 15:24:12 Job still running ...
2023/03/31 15:24:42 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-31_08_16_10-3156489466031653127 failed
--- FAIL: TestXLang_Partition (552.43s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3211.157s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680273104319641543
--- FAIL: TestBigQueryIO_BasicWriteRead (4.63s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35909 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@wOBWefAYyN" is_bounded:BOUNDED windowing_strategy_id:"w0@wOBWefAYyN"}} windowing_strategies:{key:"w0@wOBWefAYyN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@wOBWefAYyN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@wOBWefAYyN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@wOBWefAYyN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680273104319641543\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"wOBWefAYyN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35909 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@wOBWefAYyN" is_bounded:BOUNDED windowing_strategy_id:"w0@wOBWefAYyN"}} windowing_strategies:{key:"w0@wOBWefAYyN" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@wOBWefAYyN" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@wOBWefAYyN" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@wOBWefAYyN" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680273104319641543\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"wOBWefAYyN"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc0000e39c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc0000e39c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000524560?, 0xc000530000?}, {0x1137c31, 0x39}, {0xc00015c0c0?, 0xa9d780?, 0x1?}, {0xc00040b0b0, 0xf}, 0xc0000fdd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000524500?, 0xc000530000?}, {0xc0000d4360, 0x52}, {0x1?}, {0xc0000fdea8, 0x2, 0x7f665c396df8?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00040b0b0, 0xf}, {0xc0000d4360, 0x52}, {0xeba2e0, 0xc000522100})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000427a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000427a00, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.661s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-143103
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-143103
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:db5f7f923c27d96866125d672e72ef5f662f302c7f8d661312b7c2b02839e94f
Deleted: sha256:3bc68f0f2dad7e71ffd9deda6f48f01e0afe5072b95e85b1a19338157fcf3756
Deleted: sha256:5943f306b415d4d46912c5d790a0fb0500bdeac7598471bf3a2de3f8e21accb4
Deleted: sha256:205dcd6ef3696e0d6903130a2e3d6eeae8e26ee36b05e8a361f275f907c56d74
Deleted: sha256:d058698417a40448349016b0e588b3f6fcbc83d05baaad720c26e948716089e8
Deleted: sha256:6143eadf2ec32175804fa0c9d5feb10762511032bf95830781b502cc3e17013f
Deleted: sha256:ff4b68608208408c5e9adddb26264de4998e648ddc30d6f3649a19dd1a3a4b90
Deleted: sha256:191dbffbfa436eef1fd4551b40687b5486a7a2343ecb1d67ac64141df9468164
Deleted: sha256:45a40cffaee4aa1c301d95fd436bbbf78b9e1ffb8f60e4634d0c810954b677c4
Deleted: sha256:21cb2968ea52ee2cb8d98c6ebaa7ce651b2d75df71f278d36bdded94010fba55
Deleted: sha256:220c72e51454b265edb21d0ab03733276fd8187e5370a47a2fdb9c4fb2501800
Deleted: sha256:d0bc64d3bf4e9d43386ae8024b04022892ee5e7244062acd931a5eef95fe6609
Deleted: sha256:519b0a2d29f5a4bf430d13636b0fc1960f5e428c1254553f5d2f6d7cceaacad8
Deleted: sha256:93d4a4113cf61ec977ef3c2c080db1d37b77376f51b42ea81793eb289ba2dea7
Deleted: sha256:b74487a588b9a629873fd1ad435941ad83775ea16d12a8b9d146465c13ac0de8
Deleted: sha256:6de7025d7eabd0623b92b26c5e121c23a7b82f9022d247cda61054ccf7606ab9
Deleted: sha256:c1919eb4af3003d70d133ff04ca3cffa9e2e8efc75df316151387b1b0f8ffada
Deleted: sha256:27e0f995f8df14333a81e9ae6d8100db09aed2627d5850c6f2e5f95b998ecc6c
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-143103
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:db5f7f923c27d96866125d672e72ef5f662f302c7f8d661312b7c2b02839e94f
Associated tags:
- 20230331-143103
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-143103
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-143103].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:db5f7f923c27d96866125d672e72ef5f662f302c7f8d661312b7c2b02839e94f].
$ rm -rf /tmp/tmp.SfNor7JDLd
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331142038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee7b5528db646c04a78f1cd9c09c3f4224004a52f09a1aee033ba20a537f6817
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee7b5528db646c04a78f1cd9c09c3f4224004a52f09a1aee033ba20a537f6817]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee7b5528db646c04a78f1cd9c09c3f4224004a52f09a1aee033ba20a537f6817])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee7b5528db646c04a78f1cd9c09c3f4224004a52f09a1aee033ba20a537f6817
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee7b5528db646c04a78f1cd9c09c3f4224004a52f09a1aee033ba20a537f6817
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee7b5528db646c04a78f1cd9c09c3f4224004a52f09a1aee033ba20a537f6817].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331142038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f86f02272fa0f01e87749fa73ea076fcd4ecb612fbfc82cce7b8b51f25fd9c00
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f86f02272fa0f01e87749fa73ea076fcd4ecb612fbfc82cce7b8b51f25fd9c00]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f86f02272fa0f01e87749fa73ea076fcd4ecb612fbfc82cce7b8b51f25fd9c00])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f86f02272fa0f01e87749fa73ea076fcd4ecb612fbfc82cce7b8b51f25fd9c00
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f86f02272fa0f01e87749fa73ea076fcd4ecb612fbfc82cce7b8b51f25fd9c00
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f86f02272fa0f01e87749fa73ea076fcd4ecb612fbfc82cce7b8b51f25fd9c00].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1182149.
Stopping expansion service pid: 1182150.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 10s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/27awqwzzaxmmg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1468
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1468/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-083226",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-083226"
}
]
},
"name": "go-testxlang_partition-1",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/31 09:24:58 Submitted job: 2023-03-31_02_24_58-13777532435198033799
2023/03/31 09:24:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-31_02_24_58-13777532435198033799?project=apache-beam-testing
2023/03/31 09:24:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-31_02_24_58-13777532435198033799
2023/03/31 09:24:58 Job state: JOB_STATE_PENDING ...
2023/03/31 09:25:28 Job still running ...
2023/03/31 09:25:58 Job still running ...
2023/03/31 09:26:28 Job still running ...
2023/03/31 09:26:58 Job still running ...
2023/03/31 09:27:28 Job still running ...
2023/03/31 09:27:58 Job still running ...
2023/03/31 09:28:29 Job still running ...
2023/03/31 09:28:59 Job still running ...
2023/03/31 09:29:29 Job still running ...
2023/03/31 09:29:59 Job still running ...
2023/03/31 09:30:29 Job still running ...
2023/03/31 09:30:59 Job still running ...
2023/03/31 09:31:29 Job still running ...
2023/03/31 09:32:00 Job still running ...
2023/03/31 09:32:30 Job still running ...
2023/03/31 09:33:00 Job still running ...
2023/03/31 09:33:30 Job still running ...
2023/03/31 09:34:00 Job still running ...
2023/03/31 09:34:30 Job still running ...
2023/03/31 09:35:00 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-31_02_24_58-13777532435198033799 failed
--- FAIL: TestXLang_Partition (641.23s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3750.640s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680251583252631774
--- FAIL: TestBigQueryIO_BasicWriteRead (5.10s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32793 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZfrBESNLPu" is_bounded:BOUNDED windowing_strategy_id:"w0@ZfrBESNLPu"}} windowing_strategies:{key:"w0@ZfrBESNLPu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZfrBESNLPu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZfrBESNLPu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZfrBESNLPu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680251583252631774\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZfrBESNLPu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:32793 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@ZfrBESNLPu" is_bounded:BOUNDED windowing_strategy_id:"w0@ZfrBESNLPu"}} windowing_strategies:{key:"w0@ZfrBESNLPu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@ZfrBESNLPu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@ZfrBESNLPu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@ZfrBESNLPu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680251583252631774\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"ZfrBESNLPu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 57 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc0005828c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc0005828c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a6fe0?, 0xc0000bc280?}, {0x1137c31, 0x39}, {0xc0000f00c0?, 0xa9d780?, 0x1?}, {0xc0003e6ca0, 0xf}, 0xc000199d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a6f80?, 0xc0000bc280?}, {0xc0003fc360, 0x52}, {0x1?}, {0xc000199ea8, 0x2, 0x7f43f12b1448?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003e6ca0, 0xf}, {0xc0003fc360, 0x52}, {0xeba2e0, 0xc000042480})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003f91e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003f91e0, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.131s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-083226
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-083226
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:32e06b970b234ceb3ffb9eac1bd7a08bab5529d106cd4bca6c6988c3b4479aa4
Deleted: sha256:5f0a831ae400866929e8a996f98ebda20279d98f42ba27b5fad8660057380509
Deleted: sha256:67f3f557784afe39b684c308a858f3c178ff2a55da399bc849bc5b798b70b70e
Deleted: sha256:28457e0ae22a754f54510ea2c9176fc606efe3be942f73fd7de458d61d315de7
Deleted: sha256:8bf525cf58d1b50ba75c5eb3c3917adf9c6426bd3e3764cf2aec78be56493a51
Deleted: sha256:7e10d2f2fe585ec8d8f4b46ddc48fd1b64143a881242ac580de8ae8d9e39e553
Deleted: sha256:fcd0e1ab54cf3e2688f3b7d01c728982c36044e0a41111dec0ebee6d7f9a792f
Deleted: sha256:8817f95406bef2cb38294abdbef3a73a5459a9e9fe2b4b1fc0380e779f5ab409
Deleted: sha256:f8b1eb768f7680474216c000e5d8fb5452884d2224f0472ed40bab47e9535daf
Deleted: sha256:6aca0b0b363795fdac3f22ba910a56ebcacd51913802fbfee0dceed1f7bf173e
Deleted: sha256:be60e558ac957295fce39ed4cf9849c72bed12a9c8a17e2a080373cc1adeee74
Deleted: sha256:800218e3aed35445f3a6302dba458f22dbaf3df8cfa65e403d0a2c3682120e12
Deleted: sha256:d4e8b1b496bb2a35eb60a09a8afa9d203904c737b71e2779343ffd462c2f7610
Deleted: sha256:4cae6a5521d42b7f6dca15953ec8cc7d7914ebefbc92712738e0d0718a57028e
Deleted: sha256:0178cf1e8b5d7f85dc93ac1463823ab1f77c628384ca2e6ddeb761bbcd09aec8
Deleted: sha256:39009b778154d1ee3e4d65fc230ceac1814ad4655d99c1f3f7deca4d1123457b
Deleted: sha256:9099abcc878161021a0cb068345a0dca95234df5f7dc695425b353f35ff0d145
Deleted: sha256:cf35e9fb605799aea3163f27c4fc1b8d31b957d8010163c8e22ef12253a46589
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-083226
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:32e06b970b234ceb3ffb9eac1bd7a08bab5529d106cd4bca6c6988c3b4479aa4
Associated tags:
- 20230331-083226
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-083226
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-083226].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:32e06b970b234ceb3ffb9eac1bd7a08bab5529d106cd4bca6c6988c3b4479aa4].
$ rm -rf /tmp/tmp.buNVHfVfoC
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4adbdc972a64f1b3d3a4e6d468d56dbe84ac7a5ab1fbd263b38f3227171a4201
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4adbdc972a64f1b3d3a4e6d468d56dbe84ac7a5ab1fbd263b38f3227171a4201]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4adbdc972a64f1b3d3a4e6d468d56dbe84ac7a5ab1fbd263b38f3227171a4201])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4adbdc972a64f1b3d3a4e6d468d56dbe84ac7a5ab1fbd263b38f3227171a4201
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4adbdc972a64f1b3d3a4e6d468d56dbe84ac7a5ab1fbd263b38f3227171a4201
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:4adbdc972a64f1b3d3a4e6d468d56dbe84ac7a5ab1fbd263b38f3227171a4201].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8897b448fc51a8137555e2d2c07c54745ab8906d884cbe18fee4509eb202197
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8897b448fc51a8137555e2d2c07c54745ab8906d884cbe18fee4509eb202197]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8897b448fc51a8137555e2d2c07c54745ab8906d884cbe18fee4509eb202197])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8897b448fc51a8137555e2d2c07c54745ab8906d884cbe18fee4509eb202197
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8897b448fc51a8137555e2d2c07c54745ab8906d884cbe18fee4509eb202197
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8897b448fc51a8137555e2d2c07c54745ab8906d884cbe18fee4509eb202197].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 943817.
Stopping expansion service pid: 943818.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 15m 17s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/qgatjexb7wdd4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1467
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1467/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-023115",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331022039",
"environmentId": "iBEIKfyBmFbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-023115"
}
]
},
"name": "go-testxlang_partition-223",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/31 03:20:21 Submitted job: 2023-03-30_20_20_20-6184854900672582211
2023/03/31 03:20:21 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-30_20_20_20-6184854900672582211?project=apache-beam-testing
2023/03/31 03:20:21 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-30_20_20_20-6184854900672582211
2023/03/31 03:20:21 Job state: JOB_STATE_PENDING ...
2023/03/31 03:20:51 Job still running ...
2023/03/31 03:21:21 Job still running ...
2023/03/31 03:21:51 Job still running ...
2023/03/31 03:22:21 Job still running ...
2023/03/31 03:22:51 Job still running ...
2023/03/31 03:23:22 Job still running ...
2023/03/31 03:23:52 Job still running ...
2023/03/31 03:24:22 Job still running ...
2023/03/31 03:24:52 Job still running ...
2023/03/31 03:25:22 Job still running ...
2023/03/31 03:25:52 Job still running ...
2023/03/31 03:26:22 Job still running ...
2023/03/31 03:26:52 Job still running ...
2023/03/31 03:27:22 Job still running ...
2023/03/31 03:27:52 Job still running ...
2023/03/31 03:28:22 Job still running ...
2023/03/31 03:28:52 Job still running ...
2023/03/31 03:29:22 Job still running ...
2023/03/31 03:29:52 Job still running ...
2023/03/31 03:30:22 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-30_20_20_20-6184854900672582211 failed
--- FAIL: TestXLang_Partition (641.66s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3542.419s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680229913621669466
--- FAIL: TestBigQueryIO_BasicWriteRead (4.98s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41693 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FKXZZCbUvf" is_bounded:BOUNDED windowing_strategy_id:"w0@FKXZZCbUvf"}} windowing_strategies:{key:"w0@FKXZZCbUvf" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FKXZZCbUvf" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FKXZZCbUvf" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FKXZZCbUvf" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680229913621669466\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FKXZZCbUvf"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41693 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@FKXZZCbUvf" is_bounded:BOUNDED windowing_strategy_id:"w0@FKXZZCbUvf"}} windowing_strategies:{key:"w0@FKXZZCbUvf" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@FKXZZCbUvf" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@FKXZZCbUvf" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@FKXZZCbUvf" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680229913621669466\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"FKXZZCbUvf"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc000582740})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc000582740})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000412a40?, 0xc000117a40?}, {0x1137c31, 0x39}, {0xc00015e180?, 0xa9d780?, 0x1?}, {0xc00040eb40, 0xf}, 0xc00071fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0004129e0?, 0xc000117a40?}, {0xc00041c420, 0x52}, {0x1?}, {0xc00071fea8, 0x2, 0x7efe759960b0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00040eb40, 0xf}, {0xc00041c420, 0x52}, {0xeba2e0, 0xc00040fe60})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00042cd00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00042cd00, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.013s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:96c01fea8963931c186f07b6fdd3ca7b4f88797e9a483eee87b9588ff0f1faa7
Associated tags:
- 20230331-023115
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-023115
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230331-023115].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:96c01fea8963931c186f07b6fdd3ca7b4f88797e9a483eee87b9588ff0f1faa7].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d1a238600373b0b328e095c6f50970b5929253490ffb19463496b1bc01106842]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230331022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d1a238600373b0b328e095c6f50970b5929253490ffb19463496b1bc01106842])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d1a238600373b0b328e095c6f50970b5929253490ffb19463496b1bc01106842
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d1a238600373b0b328e095c6f50970b5929253490ffb19463496b1bc01106842].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331022039]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fe96190deec2fdad665e9b24bf0dfbdc9118f7588d4e4554beec77d90b6488e1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230331022039] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fe96190deec2fdad665e9b24bf0dfbdc9118f7588d4e4554beec77d90b6488e1])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fe96190deec2fdad665e9b24bf0dfbdc9118f7588d4e4554beec77d90b6488e1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fe96190deec2fdad665e9b24bf0dfbdc9118f7588d4e4554beec77d90b6488e1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 41s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/7zfcx3lm3f3wm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1466
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1466/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330211648",
"environmentId": "OwxkiCfWSCbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.47.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-213631",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-213631"
}
]
},
"name": "go-testxlang_partition-350",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/30 22:23:06 Submitted job: 2023-03-30_15_23_05-11505341082051172523
2023/03/30 22:23:06 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-30_15_23_05-11505341082051172523?project=apache-beam-testing
2023/03/30 22:23:06 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-30_15_23_05-11505341082051172523
2023/03/30 22:23:06 Job state: JOB_STATE_PENDING ...
2023/03/30 22:23:36 Job still running ...
2023/03/30 22:24:06 Job still running ...
2023/03/30 22:24:36 Job still running ...
2023/03/30 22:25:08 Job still running ...
2023/03/30 22:25:40 Job still running ...
2023/03/30 22:26:10 Job still running ...
2023/03/30 22:26:40 Job still running ...
2023/03/30 22:27:10 Job still running ...
2023/03/30 22:27:40 Job still running ...
2023/03/30 22:28:10 Job still running ...
2023/03/30 22:28:40 Job still running ...
2023/03/30 22:29:10 Job still running ...
2023/03/30 22:29:40 Job still running ...
2023/03/30 22:30:10 Job still running ...
2023/03/30 22:30:40 Job still running ...
2023/03/30 22:31:10 Job still running ...
2023/03/30 22:31:40 Job still running ...
2023/03/30 22:32:10 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-30_15_23_05-11505341082051172523 failed
--- FAIL: TestXLang_Partition (583.63s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3255.559s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680212315592077221
--- FAIL: TestBigQueryIO_BasicWriteRead (9.07s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37745 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tlMNUbjigP" is_bounded:BOUNDED windowing_strategy_id:"w0@tlMNUbjigP"}} windowing_strategies:{key:"w0@tlMNUbjigP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tlMNUbjigP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tlMNUbjigP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tlMNUbjigP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680212315592077221\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tlMNUbjigP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37745 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@tlMNUbjigP" is_bounded:BOUNDED windowing_strategy_id:"w0@tlMNUbjigP"}} windowing_strategies:{key:"w0@tlMNUbjigP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@tlMNUbjigP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@tlMNUbjigP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@tlMNUbjigP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680212315592077221\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"tlMNUbjigP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 23 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc00060ed00})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc00060ed00})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a6ba0?, 0xc000181b30?}, {0x1137c31, 0x39}, {0xc0001d20c0?, 0xa9d780?, 0x1?}, {0xc000042d00, 0xf}, 0xc000543d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a6b40?, 0xc000181b30?}, {0xc00004c4e0, 0x52}, {0x1?}, {0xc000543ea8, 0x2, 0x7f9ef92ccb98?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000042d00, 0xf}, {0xc00004c4e0, 0x52}, {0xeba2e0, 0xc0001aa0b0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00059d860)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00059d860, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 12.131s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.068s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.072s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.088s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:dcb9463a76fa14e6f87d5b5e07f63056070f55d4d1e2ed649952102aef6321a5
Associated tags:
- 20230330-213631
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-213631
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-213631].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:dcb9463a76fa14e6f87d5b5e07f63056070f55d4d1e2ed649952102aef6321a5].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330211648]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:09a2fc4d915d885e95438c79e04d38b7bf12cac88548fe1d7292082cf5f9fc79]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330211648] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:09a2fc4d915d885e95438c79e04d38b7bf12cac88548fe1d7292082cf5f9fc79])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:09a2fc4d915d885e95438c79e04d38b7bf12cac88548fe1d7292082cf5f9fc79
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:09a2fc4d915d885e95438c79e04d38b7bf12cac88548fe1d7292082cf5f9fc79].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330211648]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1227e0f34c86f15a5cab71f09313ba1e3503b722d5af852d3f2a540e201effa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330211648] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1227e0f34c86f15a5cab71f09313ba1e3503b722d5af852d3f2a540e201effa])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1227e0f34c86f15a5cab71f09313ba1e3503b722d5af852d3f2a540e201effa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1227e0f34c86f15a5cab71f09313ba1e3503b722d5af852d3f2a540e201effa].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 17m 38s
232 actionable tasks: 179 executed, 43 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/izeez6kz4zpni
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1465
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1465/display/redirect?page=changes>
Changes:
[noreply] BigQueryHelpers: log statuses using PrettyString (#26037)
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330142041",
"environmentId": "LbrXvlHbYHbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-143111"
}
]
},
"name": "go-testxlang_partition-831",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/30 15:17:25 Submitted job: 2023-03-30_08_17_24-17754020599343629676
2023/03/30 15:17:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-30_08_17_24-17754020599343629676?project=apache-beam-testing
2023/03/30 15:17:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-30_08_17_24-17754020599343629676
2023/03/30 15:17:25 Job state: JOB_STATE_PENDING ...
2023/03/30 15:17:55 Job still running ...
2023/03/30 15:18:25 Job still running ...
2023/03/30 15:18:55 Job still running ...
2023/03/30 15:19:25 Job still running ...
2023/03/30 15:19:55 Job still running ...
2023/03/30 15:20:26 Job still running ...
2023/03/30 15:20:56 Job still running ...
2023/03/30 15:21:26 Job still running ...
2023/03/30 15:21:56 Job still running ...
2023/03/30 15:22:26 Job still running ...
2023/03/30 15:22:56 Job still running ...
2023/03/30 15:23:26 Job still running ...
2023/03/30 15:23:56 Job still running ...
2023/03/30 15:24:26 Job still running ...
2023/03/30 15:24:56 Job still running ...
2023/03/30 15:25:26 Job still running ...
2023/03/30 15:25:56 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-30_08_17_24-17754020599343629676 failed
--- FAIL: TestXLang_Partition (551.60s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3281.836s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680186708147748326
--- FAIL: TestBigQueryIO_BasicWriteRead (4.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45223 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KDSiucIcxW" is_bounded:BOUNDED windowing_strategy_id:"w0@KDSiucIcxW"}} windowing_strategies:{key:"w0@KDSiucIcxW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KDSiucIcxW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KDSiucIcxW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KDSiucIcxW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680186708147748326\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KDSiucIcxW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45223 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@KDSiucIcxW" is_bounded:BOUNDED windowing_strategy_id:"w0@KDSiucIcxW"}} windowing_strategies:{key:"w0@KDSiucIcxW" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@KDSiucIcxW" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@KDSiucIcxW" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@KDSiucIcxW" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680186708147748326\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"KDSiucIcxW"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 24 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc000156440})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc000156440})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003f09c0?, 0xc00049c050?}, {0x1137c31, 0x39}, {0xc00015e0c0?, 0xa9d780?, 0x1?}, {0xc0001375a0, 0xf}, 0xc000447d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003f0960?, 0xc00049c050?}, {0xc000414300, 0x52}, {0x1?}, {0xc000447ea8, 0x2, 0x7f008849e448?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0001375a0, 0xf}, {0xc000414300, 0x52}, {0xeba2e0, 0xc000042240})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0002feb60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0002feb60, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.476s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.045s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-143111
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-143111
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4f36669c68e2c733b62a39d6f350f257c0f447b7db504f6d7ec0c53753982f77
Deleted: sha256:46cafd05267de2828f6cb6b1cc0f5215d2c5b2f5f56208ee902175bcd89e4f1a
Deleted: sha256:8733dfaf614273d5b02894a58baf7286c8df46feac9f24de54a43dbd11e874cc
Deleted: sha256:1a0529505492171c520da0f10cf0406e0394c640eeed2d2716d41b0c8ba0f63e
Deleted: sha256:f25a43f8705bf1e909346f84fe599a3954a92ab66e1b9c878d70f229eb9b9e01
Deleted: sha256:be423d4693ea17e393c865eabc82b089def101d316194b5a7dc719463a39c739
Deleted: sha256:5f8c22ce8ad8692937ec1f872dd6c9ac2380829f4b849380dba3622fd0f6efcc
Deleted: sha256:7671d7006e2de0d8b682b886d67ba44f34c51b2a1875d096716f610d0a6122ca
Deleted: sha256:e59c0c93571234ef10adc6f418ea617dea43fd31b682b2eeb0620ff3c000a136
Deleted: sha256:f6ba226059f1882e65b00069e7e33ca96772c0a266d5484ef023c50aa1a6638c
Deleted: sha256:109fe08e5a4824aa87e472588f9a0eba0d9cc519213781b6e3b036d0f73b7ffc
Deleted: sha256:89c01ab84ab6aafb2dc5e922937221148f9a97488090059122eb95c28b5a0e83
Deleted: sha256:a05750c5665c5aaf2f7784a6f43fea0fcd659a6da6a69a4176626ca8846ea46d
Deleted: sha256:cfc366d4b747b41392901c56bc6bc98f20aef970c23574150fb5149e0dfa738f
Deleted: sha256:3be76a46dc6fc4a020f2b9c44f5434b8e9e662a487b72d3cdfea33a9c3887ded
Deleted: sha256:120562a9d743c54e45b5852b42ab34fd90ad4c57f3ac2c7cb3512656b1de99f8
Deleted: sha256:d3740ac93203ad785a03266119a748c8e49a7856b25c600b4c249dd0f979f722
Deleted: sha256:8d3e22e941da97b9812f67a3156bc5a7ac09cdb620c05ba5eaaffacef908891e
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-143111
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4f36669c68e2c733b62a39d6f350f257c0f447b7db504f6d7ec0c53753982f77
Associated tags:
- 20230330-143111
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-143111
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-143111].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4f36669c68e2c733b62a39d6f350f257c0f447b7db504f6d7ec0c53753982f77].
$ rm -rf /tmp/tmp.4mej1j9qTe
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330142041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d03e40745e28943fd1fd3e5291b9475d7789a4fb1e8dac9e61a94047fc17c00
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d03e40745e28943fd1fd3e5291b9475d7789a4fb1e8dac9e61a94047fc17c00]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d03e40745e28943fd1fd3e5291b9475d7789a4fb1e8dac9e61a94047fc17c00])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d03e40745e28943fd1fd3e5291b9475d7789a4fb1e8dac9e61a94047fc17c00
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d03e40745e28943fd1fd3e5291b9475d7789a4fb1e8dac9e61a94047fc17c00
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2d03e40745e28943fd1fd3e5291b9475d7789a4fb1e8dac9e61a94047fc17c00].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330142041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:746b9a10f20f35add4a90a2882dfa28239e8978d96dad088bdd1b41ca0c3784b
Deleted: sha256:d5411deeba060a04b317e2047a35adcb90b2b24bb0aa5c5ac26097af7e643d31
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:746b9a10f20f35add4a90a2882dfa28239e8978d96dad088bdd1b41ca0c3784b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:746b9a10f20f35add4a90a2882dfa28239e8978d96dad088bdd1b41ca0c3784b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:746b9a10f20f35add4a90a2882dfa28239e8978d96dad088bdd1b41ca0c3784b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:746b9a10f20f35add4a90a2882dfa28239e8978d96dad088bdd1b41ca0c3784b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:746b9a10f20f35add4a90a2882dfa28239e8978d96dad088bdd1b41ca0c3784b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3635244.
Stopping expansion service pid: 3635245.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 10s
232 actionable tasks: 156 executed, 64 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/eyqqvbyvvqlw2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1464
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1464/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-083100",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330082038",
"environmentId": "JoDvvGzPgRbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-083100"
}
]
},
"name": "go-testxlang_partition-72",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/30 09:18:36 Submitted job: 2023-03-30_02_18_35-4016725613291348115
2023/03/30 09:18:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-30_02_18_35-4016725613291348115?project=apache-beam-testing
2023/03/30 09:18:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-30_02_18_35-4016725613291348115
2023/03/30 09:18:36 Job state: JOB_STATE_PENDING ...
2023/03/30 09:19:06 Job still running ...
2023/03/30 09:19:37 Job still running ...
2023/03/30 09:20:07 Job still running ...
2023/03/30 09:20:37 Job still running ...
2023/03/30 09:21:07 Job still running ...
2023/03/30 09:21:37 Job still running ...
2023/03/30 09:22:07 Job still running ...
2023/03/30 09:22:37 Job still running ...
2023/03/30 09:23:07 Job still running ...
2023/03/30 09:23:37 Job still running ...
2023/03/30 09:24:07 Job still running ...
2023/03/30 09:24:37 Job still running ...
2023/03/30 09:25:07 Job still running ...
2023/03/30 09:25:37 Job still running ...
2023/03/30 09:26:07 Job still running ...
2023/03/30 09:26:37 Job still running ...
2023/03/30 09:27:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-30_02_18_35-4016725613291348115 failed
--- FAIL: TestXLang_Partition (551.45s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3364.761s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680165096396349494
--- FAIL: TestBigQueryIO_BasicWriteRead (4.23s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45929 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QnBTfTPhbh" is_bounded:BOUNDED windowing_strategy_id:"w0@QnBTfTPhbh"}} windowing_strategies:{key:"w0@QnBTfTPhbh" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QnBTfTPhbh" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QnBTfTPhbh" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QnBTfTPhbh" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680165096396349494\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QnBTfTPhbh"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45929 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@QnBTfTPhbh" is_bounded:BOUNDED windowing_strategy_id:"w0@QnBTfTPhbh"}} windowing_strategies:{key:"w0@QnBTfTPhbh" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@QnBTfTPhbh" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@QnBTfTPhbh" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@QnBTfTPhbh" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680165096396349494\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"QnBTfTPhbh"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 24 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc0002ae1c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc0002ae1c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e660?, 0xc0000bc280?}, {0x1137c31, 0x39}, {0xc0000f00c0?, 0xa9d780?, 0x1?}, {0xc000654be0, 0xf}, 0xc000559d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e600?, 0xc0000bc280?}, {0xc00004ca20, 0x52}, {0x1?}, {0xc000559ea8, 0x2, 0xe79320?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000654be0, 0xf}, {0xc00004ca20, 0x52}, {0xeba2e0, 0xc000410228})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006429c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006429c0, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.259s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:33b952295f20768fcd71686f0854ca8d7d7b5358397dee5c603aea8711b484f7
Associated tags:
- 20230330-083100
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-083100
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-083100].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:33b952295f20768fcd71686f0854ca8d7d7b5358397dee5c603aea8711b484f7].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:864b7edc0fb29aad37a383c74f9468d1f4c99d767ce6646ee239e901b97d18ae]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:864b7edc0fb29aad37a383c74f9468d1f4c99d767ce6646ee239e901b97d18ae])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:864b7edc0fb29aad37a383c74f9468d1f4c99d767ce6646ee239e901b97d18ae
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:864b7edc0fb29aad37a383c74f9468d1f4c99d767ce6646ee239e901b97d18ae].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330082038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:83167e2ef009b3b6c765b3411125e9585f06050d189595d62a5557881d85b326]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330082038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:83167e2ef009b3b6c765b3411125e9585f06050d189595d62a5557881d85b326])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:83167e2ef009b3b6c765b3411125e9585f06050d189595d62a5557881d85b326
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:83167e2ef009b3b6c765b3411125e9585f06050d189595d62a5557881d85b326].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 24s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/awcby7rxovbow
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1463
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1463/display/redirect>
Changes:
------------------------------------------
[...truncated 1.00 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-023102",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330022038",
"environmentId": "jJRJIuEFARbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-023102"
}
]
},
"name": "go-testxlang_partition-172",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/30 03:17:10 Submitted job: 2023-03-29_20_17_09-9962917435422812482
2023/03/30 03:17:10 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-29_20_17_09-9962917435422812482?project=apache-beam-testing
2023/03/30 03:17:10 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-29_20_17_09-9962917435422812482
2023/03/30 03:17:10 Job state: JOB_STATE_PENDING ...
2023/03/30 03:17:40 Job still running ...
2023/03/30 03:18:10 Job still running ...
2023/03/30 03:18:40 Job still running ...
2023/03/30 03:19:10 Job still running ...
2023/03/30 03:19:40 Job still running ...
2023/03/30 03:20:10 Job still running ...
2023/03/30 03:20:40 Job still running ...
2023/03/30 03:21:10 Job still running ...
2023/03/30 03:21:40 Job still running ...
2023/03/30 03:22:10 Job still running ...
2023/03/30 03:22:40 Job still running ...
2023/03/30 03:23:10 Job still running ...
2023/03/30 03:23:40 Job still running ...
2023/03/30 03:24:10 Job still running ...
2023/03/30 03:24:40 Job still running ...
2023/03/30 03:25:10 Job still running ...
2023/03/30 03:25:40 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-29_20_17_09-9962917435422812482 failed
--- FAIL: TestXLang_Partition (550.71s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3273.784s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680143500548757201
--- FAIL: TestBigQueryIO_BasicWriteRead (4.43s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35661 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vzIlYfMpzy" is_bounded:BOUNDED windowing_strategy_id:"w0@vzIlYfMpzy"}} windowing_strategies:{key:"w0@vzIlYfMpzy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vzIlYfMpzy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vzIlYfMpzy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vzIlYfMpzy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680143500548757201\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vzIlYfMpzy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35661 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@vzIlYfMpzy" is_bounded:BOUNDED windowing_strategy_id:"w0@vzIlYfMpzy"}} windowing_strategies:{key:"w0@vzIlYfMpzy" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@vzIlYfMpzy" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@vzIlYfMpzy" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@vzIlYfMpzy" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680143500548757201\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"vzIlYfMpzy"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc000027700})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc000027700})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00040a7e0?, 0xc0004180a0?}, {0x1137c31, 0x39}, {0xc00015a0c0?, 0xa9d780?, 0x1?}, {0xc000042dc0, 0xf}, 0xc000031d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00040a760?, 0xc0004180a0?}, {0xc00004c540, 0x52}, {0x1?}, {0xc000031ea8, 0x2, 0x7fca8ea02da8?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000042dc0, 0xf}, {0xc00004c540, 0x52}, {0xeba2e0, 0xc00040e200})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000cc820)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000cc820, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.460s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:68b5bd4d4a961de0e28da9a5d1f718c25f9071e603ef1088fdb290a33432b761
Associated tags:
- 20230330-023102
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-023102
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230330-023102].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:68b5bd4d4a961de0e28da9a5d1f718c25f9071e603ef1088fdb290a33432b761].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330022038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2eadee6b5314e97d9eedceaefea44f3efca6aea86978e5639246e6067375f284]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230330022038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2eadee6b5314e97d9eedceaefea44f3efca6aea86978e5639246e6067375f284])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2eadee6b5314e97d9eedceaefea44f3efca6aea86978e5639246e6067375f284
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2eadee6b5314e97d9eedceaefea44f3efca6aea86978e5639246e6067375f284].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330022038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7fc8352ec74652008a92a7a6111ec912b69b0d773848d6a618e18a0175f8ab96]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230330022038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7fc8352ec74652008a92a7a6111ec912b69b0d773848d6a618e18a0175f8ab96])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7fc8352ec74652008a92a7a6111ec912b69b0d773848d6a618e18a0175f8ab96
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7fc8352ec74652008a92a7a6111ec912b69b0d773848d6a618e18a0175f8ab96].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 58s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/mvgd6syyuwfne
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1462
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1462/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329202042",
"environmentId": "AYLbmnZeIKbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-203248"
}
]
},
"name": "go-testxlang_partition-908",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/29 21:19:42 Submitted job: 2023-03-29_14_19_41-12216656369559825711
2023/03/29 21:19:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-29_14_19_41-12216656369559825711?project=apache-beam-testing
2023/03/29 21:19:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-29_14_19_41-12216656369559825711
2023/03/29 21:19:42 Job state: JOB_STATE_PENDING ...
2023/03/29 21:20:12 Job still running ...
2023/03/29 21:20:42 Job still running ...
2023/03/29 21:21:12 Job still running ...
2023/03/29 21:21:42 Job still running ...
2023/03/29 21:22:12 Job still running ...
2023/03/29 21:22:42 Job still running ...
2023/03/29 21:23:12 Job still running ...
2023/03/29 21:23:42 Job still running ...
2023/03/29 21:24:12 Job still running ...
2023/03/29 21:24:43 Job still running ...
2023/03/29 21:25:13 Job still running ...
2023/03/29 21:25:43 Job still running ...
2023/03/29 21:26:13 Job still running ...
2023/03/29 21:26:43 Job still running ...
2023/03/29 21:27:13 Job still running ...
2023/03/29 21:27:43 Job still running ...
2023/03/29 21:28:13 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-29_14_19_41-12216656369559825711 failed
--- FAIL: TestXLang_Partition (551.10s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3313.353s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680122018409521107
--- FAIL: TestBigQueryIO_BasicWriteRead (4.53s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43937 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kBTXfFlPPP" is_bounded:BOUNDED windowing_strategy_id:"w0@kBTXfFlPPP"}} windowing_strategies:{key:"w0@kBTXfFlPPP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kBTXfFlPPP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kBTXfFlPPP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kBTXfFlPPP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680122018409521107\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kBTXfFlPPP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:43937 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kBTXfFlPPP" is_bounded:BOUNDED windowing_strategy_id:"w0@kBTXfFlPPP"}} windowing_strategies:{key:"w0@kBTXfFlPPP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kBTXfFlPPP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kBTXfFlPPP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kBTXfFlPPP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680122018409521107\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kBTXfFlPPP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xf6c260, 0xc000021fc0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6c260, 0xc000021fc0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003f0840?, 0xc000116280?}, {0x1137c31, 0x39}, {0xc00015e0c0?, 0xa9d780?, 0x1?}, {0xc0001376a0, 0xf}, 0xc0000e9d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003f07e0?, 0xc000116280?}, {0xc000118840, 0x52}, {0x1?}, {0xc0000e9ea8, 0x2, 0xe79320?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0001376a0, 0xf}, {0xc000118840, 0x52}, {0xeba2e0, 0xc000042328})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005a2d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005a2d00, 0x1169b48)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.559s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.037s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-203248
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-203248
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:40a29a798544ee129e9ae693e5d2db576b8e24a7b14a0a947e15fa11f701e808
Deleted: sha256:1c69e31c7bef80717a12f00d84dd5c1327742a028fabe1c739af5fc29fe510a8
Deleted: sha256:9a349eefa4e9cb2a7c9610b031cb5e3e68561fa6bf0cf6c7a2299d4106724691
Deleted: sha256:37b76ce10e1ba9367fed02f0631bb982afb908f71d8d97c5a32e8fc6f06374e8
Deleted: sha256:a61a2aa626971a1bfafa20ef2262f6811c7ee8678077c0cfe627a652bb202bbc
Deleted: sha256:f51a1541a03299a6a0271b2139849c1db6ddb8034298d765ad6d5e8639cafc7b
Deleted: sha256:0f952e8da06e26c2dc6f5fd7df195a8d7c463582daf265f35ec927cbec9bac38
Deleted: sha256:2570e47f74f027de3e288a2f6d1d5133619de445fb369bc625d2883fc1685fa8
Deleted: sha256:e283d867654eeab0d330ef094ab0d29f13fe0f5d49be3f4d07cb4557eb3c8464
Deleted: sha256:16b1807ff79104d72540c650c2bcc15dee4c3aba14180735c50ae49ef9158084
Deleted: sha256:14f70d14559dcf6975d530698610a413a365267deb9fcffd1e2810a9b55ef54e
Deleted: sha256:ed7195a671fe8ac7b55504cab6de987a14dd68f41e17eb7efe65390e971b6563
Deleted: sha256:3b675ebbf3675e8253f62027b57514bd5bd4a0e3277aa76f96e379ab1ede12c7
Deleted: sha256:60ca525f128dcc2fce753e097ee169a06cc891e420cef7bcf884d422646c82ce
Deleted: sha256:6e56ce1966d6f78f8fe33be793d93cd016ef61515ef22172066d560ed89f65a5
Deleted: sha256:ca849fc1d4f429ddc26745a338c3576893fc51a367abc01b7186eab28dcf43e0
Deleted: sha256:900415ba91be73c13e21a8f705b54cfa0d49b839a5e4cf74ec9fb81c2cfd5fec
Deleted: sha256:aad3f59762abd00803aa0fc1424f4d9fb5922e0b1b6c90ac6ace37c0df8322b3
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-203248
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:40a29a798544ee129e9ae693e5d2db576b8e24a7b14a0a947e15fa11f701e808
Associated tags:
- 20230329-203248
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-203248
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-203248].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:40a29a798544ee129e9ae693e5d2db576b8e24a7b14a0a947e15fa11f701e808].
$ rm -rf /tmp/tmp.Vw0Repwxx9
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329202042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fcfde467af8ad90d3f69b2d52565763f7d6ad028b142ee7759ca6254c6b08b97
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329202042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fcfde467af8ad90d3f69b2d52565763f7d6ad028b142ee7759ca6254c6b08b97]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329202042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fcfde467af8ad90d3f69b2d52565763f7d6ad028b142ee7759ca6254c6b08b97])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fcfde467af8ad90d3f69b2d52565763f7d6ad028b142ee7759ca6254c6b08b97
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fcfde467af8ad90d3f69b2d52565763f7d6ad028b142ee7759ca6254c6b08b97
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fcfde467af8ad90d3f69b2d52565763f7d6ad028b142ee7759ca6254c6b08b97].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329202042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:324e010a3c52cc9039f4afdf87b7f4d70c267b840900690d25a827e25b84739e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329202042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:324e010a3c52cc9039f4afdf87b7f4d70c267b840900690d25a827e25b84739e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329202042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:324e010a3c52cc9039f4afdf87b7f4d70c267b840900690d25a827e25b84739e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:324e010a3c52cc9039f4afdf87b7f4d70c267b840900690d25a827e25b84739e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:324e010a3c52cc9039f4afdf87b7f4d70c267b840900690d25a827e25b84739e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:324e010a3c52cc9039f4afdf87b7f4d70c267b840900690d25a827e25b84739e].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3142531.
Stopping expansion service pid: 3142532.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 30s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/kvhmay5e2i4ca
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1461
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1461/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329142038",
"environmentId": "UxTUFTiKWHbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-143204"
}
]
},
"name": "go-testxlang_partition-803",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/29 15:20:35 Submitted job: 2023-03-29_08_20_35-6303183858765381735
2023/03/29 15:20:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-29_08_20_35-6303183858765381735?project=apache-beam-testing
2023/03/29 15:20:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-29_08_20_35-6303183858765381735
2023/03/29 15:20:35 Job state: JOB_STATE_PENDING ...
2023/03/29 15:21:05 Job still running ...
2023/03/29 15:21:35 Job still running ...
2023/03/29 15:22:05 Job still running ...
2023/03/29 15:22:35 Job still running ...
2023/03/29 15:23:05 Job still running ...
2023/03/29 15:23:35 Job still running ...
2023/03/29 15:24:06 Job still running ...
2023/03/29 15:24:36 Job still running ...
2023/03/29 15:25:06 Job still running ...
2023/03/29 15:25:36 Job still running ...
2023/03/29 15:26:06 Job still running ...
2023/03/29 15:26:36 Job still running ...
2023/03/29 15:27:06 Job still running ...
2023/03/29 15:27:36 Job still running ...
2023/03/29 15:28:06 Job still running ...
2023/03/29 15:28:36 Job still running ...
2023/03/29 15:29:06 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-29_08_20_35-6303183858765381735 failed
--- FAIL: TestXLang_Partition (550.83s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3420.502s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680100359488633967
--- FAIL: TestBigQueryIO_BasicWriteRead (4.67s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37915 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kCgEvOoUcd" is_bounded:BOUNDED windowing_strategy_id:"w0@kCgEvOoUcd"}} windowing_strategies:{key:"w0@kCgEvOoUcd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kCgEvOoUcd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kCgEvOoUcd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kCgEvOoUcd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680100359488633967\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kCgEvOoUcd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37915 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kCgEvOoUcd" is_bounded:BOUNDED windowing_strategy_id:"w0@kCgEvOoUcd"}} windowing_strategies:{key:"w0@kCgEvOoUcd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kCgEvOoUcd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kCgEvOoUcd" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kCgEvOoUcd" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680100359488633967\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kCgEvOoUcd"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xf71820, 0xc0004268c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf71820, 0xc0004268c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000400c20?, 0xc000117b30?}, {0x113df7e, 0x39}, {0xc00015e0c0?, 0xa9eec0?, 0x1?}, {0xc000422cb0, 0xf}, 0xc000159d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000400bc0?, 0xc000117b30?}, {0xc000118840, 0x52}, {0x1?}, {0xc000159ea8, 0x2, 0x7f0f48b865d0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000422cb0, 0xf}, {0xc000118840, 0x52}, {0xebf2a0, 0xc000423fc0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0005c29c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0005c29c0, 0x116fe90)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.703s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.032s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.041s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-143204
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-143204
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:baaf3edfea010e50a0de5750898e66aceb2dd575178172bcca0d9d6ed04ed3c8
Deleted: sha256:4724e78b2526dbd26b7a14c4823205dfa68ee96382cb01bdc32ed75c2caeec1b
Deleted: sha256:80fb628d14f3c9aa98cc14335dc10dd4fa11f2fb98b1ac79281c1946e8720796
Deleted: sha256:60e698a5dd2e0fbae297bad57205b0b8f8ddc95c0ca31ab6e029f46d2318287f
Deleted: sha256:201ceeb1a9adffd89431ac789db1ae81dcc4f30889a470032af496583c17e8b8
Deleted: sha256:97cf28562512ff189cfa7d40b26ca357c3fc3d0c5348163a6151dededfd413e8
Deleted: sha256:4e5acc96c0755f23d2955a532b7afadefc5455649dbad527b5796119d4ce1eb7
Deleted: sha256:b5fef6366eed6f722f0be4875bfdc3ac958aa340b846221f741276a97f172d81
Deleted: sha256:a449954be4088daf1dfac722c2d496a3dfb7abbdb418dab5705757497a090bba
Deleted: sha256:b6c9049a8c39f0d20eb49a5712ec9241c33f396aa1c2e75e2506fa7db2b7fe74
Deleted: sha256:ac81697b3f8b9c4b68938dc9df716e3d86788d7af4ea06283a6d36ad065c17b0
Deleted: sha256:7e7ac86dd96bbb64649a463d77143963b41ee08ef421a48a4439f6e8ddc6d59d
Deleted: sha256:8de6ae42e55fc704e13dc3712c58bc6468ec4ec97ecf3a2f97da01253e0c0276
Deleted: sha256:466f49dc6bce5dd3480a92e4e0e1cca9b57fa954a029f78eb40773b8986d7ec7
Deleted: sha256:4203f6572068607d8fefda465d3d84f0071e105e0a419beedc8c33e4fd71f7fc
Deleted: sha256:c0219179823345a2bcd58f4066499691e053a8b7e149ec46183deee2d6a4b7a1
Deleted: sha256:540836f2b961c50ef1afcd4235ecaf5d60a79f22cfa6b6b0581f7137f7585aba
Deleted: sha256:f8837cb26dbd10e2507407e45d50f0ac1716e0f7f3e86950f4f940dd7a1b7532
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-143204
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:baaf3edfea010e50a0de5750898e66aceb2dd575178172bcca0d9d6ed04ed3c8
Associated tags:
- 20230329-143204
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-143204
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-143204].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:baaf3edfea010e50a0de5750898e66aceb2dd575178172bcca0d9d6ed04ed3c8].
$ rm -rf /tmp/tmp.roGkwuZUT4
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329142038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a750b8edbe2adc86a52ca7b7a7f77aab49eefb6941502c0bbeaf165b5ebcbeaa
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a750b8edbe2adc86a52ca7b7a7f77aab49eefb6941502c0bbeaf165b5ebcbeaa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a750b8edbe2adc86a52ca7b7a7f77aab49eefb6941502c0bbeaf165b5ebcbeaa])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a750b8edbe2adc86a52ca7b7a7f77aab49eefb6941502c0bbeaf165b5ebcbeaa
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a750b8edbe2adc86a52ca7b7a7f77aab49eefb6941502c0bbeaf165b5ebcbeaa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a750b8edbe2adc86a52ca7b7a7f77aab49eefb6941502c0bbeaf165b5ebcbeaa].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329142038
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a70f604caa9225a947ea67cccd793c5a877f19cd04ef28d5b5c01dc977aa2bc5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a70f604caa9225a947ea67cccd793c5a877f19cd04ef28d5b5c01dc977aa2bc5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a70f604caa9225a947ea67cccd793c5a877f19cd04ef28d5b5c01dc977aa2bc5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a70f604caa9225a947ea67cccd793c5a877f19cd04ef28d5b5c01dc977aa2bc5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a70f604caa9225a947ea67cccd793c5a877f19cd04ef28d5b5c01dc977aa2bc5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a70f604caa9225a947ea67cccd793c5a877f19cd04ef28d5b5c01dc977aa2bc5].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2495814.
Stopping expansion service pid: 2495815.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 9m 25s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/yopypg7fswdpo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1460
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1460/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329082029",
"environmentId": "skNbtWukkWbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.47.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-083146",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-083146"
}
]
},
"name": "go-testxlang_partition-36",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/29 09:18:58 Submitted job: 2023-03-29_02_18_57-16657939550964321550
2023/03/29 09:18:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-29_02_18_57-16657939550964321550?project=apache-beam-testing
2023/03/29 09:18:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-29_02_18_57-16657939550964321550
2023/03/29 09:18:58 Job state: JOB_STATE_PENDING ...
2023/03/29 09:19:28 Job still running ...
2023/03/29 09:19:58 Job still running ...
2023/03/29 09:20:28 Job still running ...
2023/03/29 09:20:58 Job still running ...
2023/03/29 09:21:28 Job still running ...
2023/03/29 09:21:58 Job still running ...
2023/03/29 09:22:28 Job still running ...
2023/03/29 09:22:58 Job still running ...
2023/03/29 09:23:28 Job still running ...
2023/03/29 09:23:58 Job still running ...
2023/03/29 09:24:28 Job still running ...
2023/03/29 09:24:58 Job still running ...
2023/03/29 09:25:29 Job still running ...
2023/03/29 09:25:59 Job still running ...
2023/03/29 09:26:29 Job still running ...
2023/03/29 09:26:59 Job still running ...
2023/03/29 09:27:29 Job still running ...
2023/03/29 09:27:59 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-29_02_18_57-16657939550964321550 failed
--- FAIL: TestXLang_Partition (580.51s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3361.168s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680078757503730946
--- FAIL: TestBigQueryIO_BasicWriteRead (4.79s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44837 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RoYtuXYMjT" is_bounded:BOUNDED windowing_strategy_id:"w0@RoYtuXYMjT"}} windowing_strategies:{key:"w0@RoYtuXYMjT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RoYtuXYMjT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RoYtuXYMjT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RoYtuXYMjT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680078757503730946\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RoYtuXYMjT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:44837 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RoYtuXYMjT" is_bounded:BOUNDED windowing_strategy_id:"w0@RoYtuXYMjT"}} windowing_strategies:{key:"w0@RoYtuXYMjT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RoYtuXYMjT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RoYtuXYMjT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RoYtuXYMjT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680078757503730946\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RoYtuXYMjT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xf71820, 0xc0001ccb40})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf71820, 0xc0001ccb40})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0005a2580?, 0xc0005d0000?}, {0x113df7e, 0x39}, {0xc0001d20c0?, 0xa9eec0?, 0x1?}, {0xc000596d30, 0xf}, 0xc000033d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005a2520?, 0xc0005d0000?}, {0xc0005b6360, 0x52}, {0x1?}, {0xc000033ea8, 0x2, 0x7f2da834f448?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000596d30, 0xf}, {0xc0005b6360, 0x52}, {0xebf2a0, 0xc000042190})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004bcb60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004bcb60, 0x116fe90)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.824s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.040s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.037s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3d0fd9b1ddfc441703f1949b573b7267df661719f9f8dc74071c62049239037a
Associated tags:
- 20230329-083146
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-083146
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-083146].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3d0fd9b1ddfc441703f1949b573b7267df661719f9f8dc74071c62049239037a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329082029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cf21783bf63a97082d2d89594b2d77d8b5b77423ab038f85f10b75dd10adb496]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329082029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cf21783bf63a97082d2d89594b2d77d8b5b77423ab038f85f10b75dd10adb496])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cf21783bf63a97082d2d89594b2d77d8b5b77423ab038f85f10b75dd10adb496
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:cf21783bf63a97082d2d89594b2d77d8b5b77423ab038f85f10b75dd10adb496].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329082029]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9829cd3c0c9921e63480b7f50c3a5d60576ca6e3eb133646115640d0aa40ffb8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329082029] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9829cd3c0c9921e63480b7f50c3a5d60576ca6e3eb133646115640d0aa40ffb8])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9829cd3c0c9921e63480b7f50c3a5d60576ca6e3eb133646115640d0aa40ffb8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9829cd3c0c9921e63480b7f50c3a5d60576ca6e3eb133646115640d0aa40ffb8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 27s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/otdasweoyxnra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1459
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1459/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329022036",
"environmentId": "WFWTMoKrSmbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-023054"
}
]
},
"name": "go-testxlang_partition-971",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/29 03:16:27 Submitted job: 2023-03-28_20_16_26-677333721022484550
2023/03/29 03:16:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-28_20_16_26-677333721022484550?project=apache-beam-testing
2023/03/29 03:16:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-28_20_16_26-677333721022484550
2023/03/29 03:16:27 Job state: JOB_STATE_PENDING ...
2023/03/29 03:16:57 Job still running ...
2023/03/29 03:17:27 Job still running ...
2023/03/29 03:17:57 Job still running ...
2023/03/29 03:18:27 Job still running ...
2023/03/29 03:18:57 Job still running ...
2023/03/29 03:19:27 Job still running ...
2023/03/29 03:19:57 Job still running ...
2023/03/29 03:20:27 Job still running ...
2023/03/29 03:21:00 Job still running ...
2023/03/29 03:21:30 Job still running ...
2023/03/29 03:22:00 Job still running ...
2023/03/29 03:22:30 Job still running ...
2023/03/29 03:23:00 Job still running ...
2023/03/29 03:23:30 Job still running ...
2023/03/29 03:24:00 Job still running ...
2023/03/29 03:24:30 Job still running ...
2023/03/29 03:25:00 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-28_20_16_26-677333721022484550 failed
--- FAIL: TestXLang_Partition (553.74s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3241.663s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680057092463848105
--- FAIL: TestBigQueryIO_BasicWriteRead (4.38s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34493 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@HIiHoUvpFh" is_bounded:BOUNDED windowing_strategy_id:"w0@HIiHoUvpFh"}} windowing_strategies:{key:"w0@HIiHoUvpFh" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@HIiHoUvpFh" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@HIiHoUvpFh" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@HIiHoUvpFh" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680057092463848105\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"HIiHoUvpFh"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34493 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@HIiHoUvpFh" is_bounded:BOUNDED windowing_strategy_id:"w0@HIiHoUvpFh"}} windowing_strategies:{key:"w0@HIiHoUvpFh" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@HIiHoUvpFh" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@HIiHoUvpFh" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@HIiHoUvpFh" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680057092463848105\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"HIiHoUvpFh"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 7 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0004b5fc0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0004b5fc0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001160e0?, 0xc0005be4b0?}, {0x113b23e, 0x39}, {0xc0000ee0c0?, 0xa9ea20?, 0x1?}, {0xc000472a60, 0xf}, 0xc0004cfd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000116040?, 0xc0005be4b0?}, {0xc00004c900, 0x52}, {0x1?}, {0xc0004cfea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000472a60, 0xf}, {0xc00004c900, 0x52}, {0xebcb60, 0xc00012a108})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103380, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.411s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-023054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-023054
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:afcbc173c042d845d9019e858869e98433baf12fbea5ff828ada3ea71aa9a32e
Deleted: sha256:c779765edd4924bfe67c615265dd7a4dbb18c661bc6e13262b6c48aed5ce1e27
Deleted: sha256:d44bbd3066679177a8206ee89ea6c511220ffb60072cef32985c5ccdae6490f2
Deleted: sha256:bd42cddbb05446cef2bb27bbe5362dcdf1a1943dff325e60ac3f235310a5fe18
Deleted: sha256:f9e7670c1b28a07509bc57c46377cab0f5159a3936398e24509861b550f9c3e2
Deleted: sha256:aad37464560d07d09b0079bdaf1e6ba6c8a96a90f4338735012376fd1ce52ea9
Deleted: sha256:a21bfc96b03626d43268f8ac7965054cc7d94cac0b335f97c7c0849562a960b4
Deleted: sha256:c617ef7ac2c013bf489d6f4be9fc9974fe9d7b3c7fccea50540ef3cbb221cdd4
Deleted: sha256:6bf143c8f361bb31c156212f649e336665ca70ac7fa542d0d0ac653310b87371
Deleted: sha256:2c4cb4fc830a25a2c6a46a0797e3076d8cab4c17cf7cf7fbccd772bf6936f77a
Deleted: sha256:cbc2508a24b15508c1d4009e02fa10423f58db45abd215ab91732f65d8b92d22
Deleted: sha256:307b3c550970b43f0921516a489326661f936e14f0bb6608eaa20a49dc0bacab
Deleted: sha256:62b3f3913683dd5210b4781eda2d5d1e4f911951a5bfdd424518bedb7b3c0232
Deleted: sha256:241ea30c74a2e1ec1a5f4a8c9bc104ce0cac3e0f5f79658870e8b1b055eaf73f
Deleted: sha256:035817c323e1426d3448bf1d8fec5b5d5b31f99f0007565d375eeb63cc1aa200
Deleted: sha256:b36a5086a620c53255d5583dad86c252c43988e738f343304f0cb9539623abce
Deleted: sha256:33cf221b847b83a6a71eed4fad92931239b98eda62abfc6c24947588718986f1
Deleted: sha256:9ffe728936d0b7e59406d5402605edc8fae292304a836c888d79de413e6206ac
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-023054
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:afcbc173c042d845d9019e858869e98433baf12fbea5ff828ada3ea71aa9a32e
Associated tags:
- 20230329-023054
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-023054
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230329-023054].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:afcbc173c042d845d9019e858869e98433baf12fbea5ff828ada3ea71aa9a32e].
$ rm -rf /tmp/tmp.4QLJLRWgR1
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329022036
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6fbbb0ed2c5045ab8b3091ec4181d6ba6093e4ffd94a4fd06e1d3ce2d12b34f6
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329022036]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6fbbb0ed2c5045ab8b3091ec4181d6ba6093e4ffd94a4fd06e1d3ce2d12b34f6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230329022036] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6fbbb0ed2c5045ab8b3091ec4181d6ba6093e4ffd94a4fd06e1d3ce2d12b34f6])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6fbbb0ed2c5045ab8b3091ec4181d6ba6093e4ffd94a4fd06e1d3ce2d12b34f6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6fbbb0ed2c5045ab8b3091ec4181d6ba6093e4ffd94a4fd06e1d3ce2d12b34f6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6fbbb0ed2c5045ab8b3091ec4181d6ba6093e4ffd94a4fd06e1d3ce2d12b34f6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329022036
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6762f89ab29259ed776894cf5f30588a8fefad94d43952864ae10d5af21b52f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329022036]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6762f89ab29259ed776894cf5f30588a8fefad94d43952864ae10d5af21b52f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230329022036] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6762f89ab29259ed776894cf5f30588a8fefad94d43952864ae10d5af21b52f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6762f89ab29259ed776894cf5f30588a8fefad94d43952864ae10d5af21b52f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6762f89ab29259ed776894cf5f30588a8fefad94d43952864ae10d5af21b52f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b6762f89ab29259ed776894cf5f30588a8fefad94d43952864ae10d5af21b52f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1829887.
Stopping expansion service pid: 1829888.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 18s
232 actionable tasks: 162 executed, 58 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/b6fcdzzgqx3pk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1458
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1458/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328202054",
"environmentId": "qUamQeCeNwbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-203248"
}
]
},
"name": "go-testxlang_partition-351",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/28 21:21:13 Submitted job: 2023-03-28_14_21_12-3695999268457143006
2023/03/28 21:21:13 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-28_14_21_12-3695999268457143006?project=apache-beam-testing
2023/03/28 21:21:13 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-28_14_21_12-3695999268457143006
2023/03/28 21:21:13 Job state: JOB_STATE_PENDING ...
2023/03/28 21:21:43 Job still running ...
2023/03/28 21:22:13 Job still running ...
2023/03/28 21:22:43 Job still running ...
2023/03/28 21:23:13 Job still running ...
2023/03/28 21:23:43 Job still running ...
2023/03/28 21:24:13 Job still running ...
2023/03/28 21:24:43 Job still running ...
2023/03/28 21:25:13 Job still running ...
2023/03/28 21:25:43 Job still running ...
2023/03/28 21:26:13 Job still running ...
2023/03/28 21:26:44 Job still running ...
2023/03/28 21:27:14 Job still running ...
2023/03/28 21:27:44 Job still running ...
2023/03/28 21:28:14 Job still running ...
2023/03/28 21:28:44 Job still running ...
2023/03/28 21:29:14 Job still running ...
2023/03/28 21:29:44 Job still running ...
2023/03/28 21:30:25 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-28_14_21_12-3695999268457143006 failed
--- FAIL: TestXLang_Partition (592.68s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3437.846s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680035620840784307
--- FAIL: TestBigQueryIO_BasicWriteRead (5.04s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42705 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@rSrYjJgktk" is_bounded:BOUNDED windowing_strategy_id:"w0@rSrYjJgktk"}} windowing_strategies:{key:"w0@rSrYjJgktk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@rSrYjJgktk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@rSrYjJgktk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@rSrYjJgktk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680035620840784307\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"rSrYjJgktk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42705 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@rSrYjJgktk" is_bounded:BOUNDED windowing_strategy_id:"w0@rSrYjJgktk"}} windowing_strategies:{key:"w0@rSrYjJgktk" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@rSrYjJgktk" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@rSrYjJgktk" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@rSrYjJgktk" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1680035620840784307\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"rSrYjJgktk"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 5 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc00029a700})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc00029a700})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000419c80?, 0xc00042f770?}, {0x113b23e, 0x39}, {0xc00015a0c0?, 0xa9ea20?, 0x1?}, {0xc000423360, 0xf}, 0xc0000efd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000419c20?, 0xc00042f770?}, {0xc0004b04e0, 0x52}, {0x1?}, {0xc0000efea8, 0x2, 0x7faa21dd1998?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000423360, 0xf}, {0xc0004b04e0, 0x52}, {0xebcb60, 0xc000130fc0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000314340)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000314340, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.065s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-203248
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-203248
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:bd2ad2d3286e9d9ebdd55a0ddb3dd0db9f07eab7bcb17b4eb1d7c2651ef143ff
Deleted: sha256:ffc1c6a1199efcea51bcf2b7e07c03b4f2d3bc9d3a25399b0ff9b223427aca9d
Deleted: sha256:7b3e50f92d3e0f35af96ddb40f5aa04e019f0804770d8e8e86a6f943659d4361
Deleted: sha256:f85a4d4d03c1f0799066c2ce4599b354c7c95d34af137ba695998d29761eedf6
Deleted: sha256:f491c1f7abd12e76cbeda5ac6ab5b27c53abbb02926c0b5536bc8f5f34032a7c
Deleted: sha256:f18d45b7cc161045a2e4ed031ad81edd40d4faae31374bc4a7bd87114f5eaf3f
Deleted: sha256:c67eb4a53be014caec21819ccb4dd940c822c1518985a82b6583b973d54d5345
Deleted: sha256:f5d4af28220635188d10147dbafbfd82092e22000dcf27b3cf546ea86b247aac
Deleted: sha256:347804ae0689d8bdeb4e141c91485d0f162b70fb60ba415ed080ed8ea995cfbd
Deleted: sha256:75b4ac1ebe9797f2880d1f00a3b21bb32e3f4e87ce60d99e41186a2c50b3cd3f
Deleted: sha256:53c2f6a1a26422f464a090c3695d6cc7c5508d2cb8e7a5bdd97db7522f53b88a
Deleted: sha256:11eb287577cd6159542ba55985b6cd0cf9733cf7810a64bba77ddfd98b72d159
Deleted: sha256:30b62e923bb00788ad9b95ba84424bbdb6bba9504084d742bccac9eccca02b8c
Deleted: sha256:673125c172e07a06257962e77ec3ab2891f1b15f00a221d74946074097c6d3ae
Deleted: sha256:0b92e3b35e238c080bc98bd456406f34c93c5c37d4aa14d614b4a3750e6f06e3
Deleted: sha256:e0a578e510e898536a63704278ebc1a68c9a7a4b025de67d4dd21734280e352d
Deleted: sha256:047a9346018bdf51e8a9e0ae5f99d596084edff690a2e8d435b625add16fc7f3
Deleted: sha256:e508b6af51427e2c6e9115967e62dec94c6bb481e278941570d98ede21b41395
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-203248
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:bd2ad2d3286e9d9ebdd55a0ddb3dd0db9f07eab7bcb17b4eb1d7c2651ef143ff
Associated tags:
- 20230328-203248
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-203248
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-203248].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:bd2ad2d3286e9d9ebdd55a0ddb3dd0db9f07eab7bcb17b4eb1d7c2651ef143ff].
$ rm -rf /tmp/tmp.qFADOpqVAA
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328202054
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b3772702b998ba89e95f0079a9c1123a8a276087e1fa305c99c00a7ea4aaf95d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328202054]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b3772702b998ba89e95f0079a9c1123a8a276087e1fa305c99c00a7ea4aaf95d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328202054] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b3772702b998ba89e95f0079a9c1123a8a276087e1fa305c99c00a7ea4aaf95d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b3772702b998ba89e95f0079a9c1123a8a276087e1fa305c99c00a7ea4aaf95d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b3772702b998ba89e95f0079a9c1123a8a276087e1fa305c99c00a7ea4aaf95d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b3772702b998ba89e95f0079a9c1123a8a276087e1fa305c99c00a7ea4aaf95d].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328202054
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b1d08fe2097560c5329f55deb6a5ca30601554e2df7acccd0b7f166f583bac7b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328202054]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b1d08fe2097560c5329f55deb6a5ca30601554e2df7acccd0b7f166f583bac7b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328202054] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b1d08fe2097560c5329f55deb6a5ca30601554e2df7acccd0b7f166f583bac7b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b1d08fe2097560c5329f55deb6a5ca30601554e2df7acccd0b7f166f583bac7b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b1d08fe2097560c5329f55deb6a5ca30601554e2df7acccd0b7f166f583bac7b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b1d08fe2097560c5329f55deb6a5ca30601554e2df7acccd0b7f166f583bac7b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1488810.
Stopping expansion service pid: 1488811.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 28s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ovvlv6h36yzzg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_XVR_GoUsingJava_Dataflow - Build # 1457 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_GoUsingJava_Dataflow - Build # 1457 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1457/ to view the results.
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1456
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1456/display/redirect?page=changes>
Changes:
[noreply] BigQuery Storage Write API wrapper for Python SDK (#25685)
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328082045",
"environmentId": "APzuHOUVoWbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-083121"
}
]
},
"name": "go-testxlang_partition-955",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/28 09:16:26 Submitted job: 2023-03-28_02_16_25-11874950351200018049
2023/03/28 09:16:26 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-28_02_16_25-11874950351200018049?project=apache-beam-testing
2023/03/28 09:16:26 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-28_02_16_25-11874950351200018049
2023/03/28 09:16:26 Job state: JOB_STATE_PENDING ...
2023/03/28 09:16:56 Job still running ...
2023/03/28 09:17:26 Job still running ...
2023/03/28 09:17:56 Job still running ...
2023/03/28 09:18:26 Job still running ...
2023/03/28 09:18:56 Job still running ...
2023/03/28 09:19:26 Job still running ...
2023/03/28 09:19:57 Job still running ...
2023/03/28 09:20:27 Job still running ...
2023/03/28 09:20:57 Job still running ...
2023/03/28 09:21:27 Job still running ...
2023/03/28 09:21:57 Job still running ...
2023/03/28 09:22:27 Job still running ...
2023/03/28 09:22:57 Job still running ...
2023/03/28 09:23:27 Job still running ...
2023/03/28 09:23:57 Job still running ...
2023/03/28 09:24:27 Job still running ...
2023/03/28 09:24:57 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-28_02_16_25-11874950351200018049 failed
--- FAIL: TestXLang_Partition (551.25s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3211.006s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679992319907667271
--- FAIL: TestBigQueryIO_BasicWriteRead (4.87s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40591 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WnmmvjQhGC" is_bounded:BOUNDED windowing_strategy_id:"w0@WnmmvjQhGC"}} windowing_strategies:{key:"w0@WnmmvjQhGC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WnmmvjQhGC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WnmmvjQhGC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WnmmvjQhGC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679992319907667271\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WnmmvjQhGC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40591 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@WnmmvjQhGC" is_bounded:BOUNDED windowing_strategy_id:"w0@WnmmvjQhGC"}} windowing_strategies:{key:"w0@WnmmvjQhGC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@WnmmvjQhGC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@WnmmvjQhGC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@WnmmvjQhGC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679992319907667271\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"WnmmvjQhGC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 52 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0003ed240})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0003ed240})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e6c0?, 0xc0000bc280?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc0003eb070, 0xf}, 0xc0005cbd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00010e660?, 0xc0000bc280?}, {0xc00059e3c0, 0x52}, {0x1?}, {0xc0005cbea8, 0x2, 0x7fd2f81d7d50?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003eb070, 0xf}, {0xc00059e3c0, 0x52}, {0xebcb60, 0xc00011e1c0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000407a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000407a00, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.905s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-083121
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-083121
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:29fe172ca8daa2b71355262fc931fe8c83c713de792c2a9b689bde39462afe1b
Deleted: sha256:e4a1b37adcd6a0a0fd166e4f997d1c3c10f281309974ab17ba1c51bbf384993d
Deleted: sha256:e16d3cc8803558103c560677778fee79dcc46404936b58d9649551552244c1a0
Deleted: sha256:9d8991e298c609630c691e28d70cd7a88895a682c8d84a9078a53b5c0ac6e904
Deleted: sha256:8d0261af76fca811dcd94038ecdfa71bbc030fbad19601e16bf10a6c7fe28479
Deleted: sha256:6791cbc61e9528dedce94e55a7a88b22e0cb4a037ce59d4a57e3a8eadaa7d94f
Deleted: sha256:0db42504370501ac79100b7c3f256db392bdc5398f0370c65927cdb712f7cc6b
Deleted: sha256:3d0b69051ca0f83fc301e8df72d1dbf2868a64f0cb98e57c9c4ca3db004913cc
Deleted: sha256:0c142950a5e87b6e1b87d07c9a00ff508a4619d18d66665a80cdc0b6cfb821d5
Deleted: sha256:24d25359216e1c3b29154e50798abba4e11a0b67f805235c2075f4675cecbf3e
Deleted: sha256:375ab8bbbafa8775b99e73828a0f4f4ee806617be53ff41297b63607c4ff3c9a
Deleted: sha256:03f291b51609d09b8589b55e43bfd9240caa7b5e2aaeed1ec867a12c43fd1378
Deleted: sha256:400d025d3fd48820b07b8348bc6f7dfcd0ca90788dfb62dc0d5c32647c6477a1
Deleted: sha256:d559e8ab42aca1f9ce93f73f314a76ea64deaf482602573bcc9685f06dbbe057
Deleted: sha256:cd23ba28f749fb59a3a7ff283a51883c5f51a1cbdc83be943dd8369d367e5911
Deleted: sha256:07a44ee2f4ae401c2edb097c1a4c33b26dd0afe941bdbd28393d15b09e6df87e
Deleted: sha256:e0e3098fafd5cc5766a8bbac1dea753f035afa4ee39498b3e343eaf1f3d9fece
Deleted: sha256:4f033e8f642260da94b64910afdff8e55ecaf1c113f7c3264f453094155bc393
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-083121
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:29fe172ca8daa2b71355262fc931fe8c83c713de792c2a9b689bde39462afe1b
Associated tags:
- 20230328-083121
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-083121
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-083121].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:29fe172ca8daa2b71355262fc931fe8c83c713de792c2a9b689bde39462afe1b].
$ rm -rf /tmp/tmp.6jGBHeEHzy
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328082045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5d3cadd2d9046c8b91fe9868819e40c8deff6062cf3df8f14728ec178c82f45
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328082045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5d3cadd2d9046c8b91fe9868819e40c8deff6062cf3df8f14728ec178c82f45]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328082045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5d3cadd2d9046c8b91fe9868819e40c8deff6062cf3df8f14728ec178c82f45])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5d3cadd2d9046c8b91fe9868819e40c8deff6062cf3df8f14728ec178c82f45
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5d3cadd2d9046c8b91fe9868819e40c8deff6062cf3df8f14728ec178c82f45
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5d3cadd2d9046c8b91fe9868819e40c8deff6062cf3df8f14728ec178c82f45].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328082045
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077e6065bd5b24bc65f447316bd6a53df710e13cb3f71997b402ccd418e4f87f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328082045]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077e6065bd5b24bc65f447316bd6a53df710e13cb3f71997b402ccd418e4f87f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328082045] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077e6065bd5b24bc65f447316bd6a53df710e13cb3f71997b402ccd418e4f87f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077e6065bd5b24bc65f447316bd6a53df710e13cb3f71997b402ccd418e4f87f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077e6065bd5b24bc65f447316bd6a53df710e13cb3f71997b402ccd418e4f87f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:077e6065bd5b24bc65f447316bd6a53df710e13cb3f71997b402ccd418e4f87f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1165797.
Stopping expansion service pid: 1165798.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 9s
232 actionable tasks: 164 executed, 56 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ttj2bk6m4imuq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1455
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1455/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328022050",
"environmentId": "UKYLRvJWIXbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-023152"
}
]
},
"name": "go-testxlang_partition-630",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/28 03:18:28 Submitted job: 2023-03-27_20_18_28-15853063071008360952
2023/03/28 03:18:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-27_20_18_28-15853063071008360952?project=apache-beam-testing
2023/03/28 03:18:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-27_20_18_28-15853063071008360952
2023/03/28 03:18:29 Job state: JOB_STATE_PENDING ...
2023/03/28 03:18:59 Job still running ...
2023/03/28 03:19:29 Job still running ...
2023/03/28 03:19:59 Job still running ...
2023/03/28 03:20:29 Job still running ...
2023/03/28 03:20:59 Job still running ...
2023/03/28 03:21:29 Job still running ...
2023/03/28 03:21:59 Job still running ...
2023/03/28 03:22:29 Job still running ...
2023/03/28 03:22:59 Job still running ...
2023/03/28 03:23:29 Job still running ...
2023/03/28 03:23:59 Job still running ...
2023/03/28 03:24:29 Job still running ...
2023/03/28 03:24:59 Job still running ...
2023/03/28 03:25:29 Job still running ...
2023/03/28 03:25:59 Job still running ...
2023/03/28 03:26:29 Job still running ...
2023/03/28 03:26:59 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-27_20_18_28-15853063071008360952 failed
--- FAIL: TestXLang_Partition (550.91s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3303.831s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679970749211689752
--- FAIL: TestBigQueryIO_BasicWriteRead (4.57s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38607 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@UKDcwjseBm" is_bounded:BOUNDED windowing_strategy_id:"w0@UKDcwjseBm"}} windowing_strategies:{key:"w0@UKDcwjseBm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@UKDcwjseBm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UKDcwjseBm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@UKDcwjseBm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679970749211689752\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"UKDcwjseBm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38607 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@UKDcwjseBm" is_bounded:BOUNDED windowing_strategy_id:"w0@UKDcwjseBm"}} windowing_strategies:{key:"w0@UKDcwjseBm" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@UKDcwjseBm" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UKDcwjseBm" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@UKDcwjseBm" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679970749211689752\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"UKDcwjseBm"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0000b1d40})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0000b1d40})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000169120?, 0xc000138280?}, {0x113b23e, 0x39}, {0xc00015a0c0?, 0xa9ea20?, 0x1?}, {0xc00041acb0, 0xf}, 0xc0000f1d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0001690c0?, 0xc000138280?}, {0xc0003f83c0, 0x52}, {0x1?}, {0xc0000f1ea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00041acb0, 0xf}, {0xc0003f83c0, 0x52}, {0xebcb60, 0xc0001304e8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004231e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004231e0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.602s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.029s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.032s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-023152
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-023152
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:70f3cf41ce413fd3a23536970b300da103d3f811a6b27790f2ee7f68914da45b
Deleted: sha256:35aa67d8d7819e6766d22dd0f5cb615a2eb5f3a35fb972266455a281089dc304
Deleted: sha256:6d3322ea32a49a739a70ce9257f29a1249712e644105eacd8fa308e81b67cd19
Deleted: sha256:56ddddabf2cd3b972b8724df0ba5c7a1116752400367a1f8813c38e1011a0c2a
Deleted: sha256:bf4f00be97b1a6f22166c98478ddd9a3b40a6283bbcb16df9fc97478f639de1b
Deleted: sha256:87ec8730449a8f1f6f3510b09bc075a1e417a4f1aace5d97a03aef6fa07cec27
Deleted: sha256:e6e25f8efc0c32470cd2aa808d331029410441788aaedace7e59bb70cf091c1f
Deleted: sha256:71227a5563fd8c4351f9037924ef3d4cbc063610cdf7b8c95d8d3d6cb4cb69ec
Deleted: sha256:5cd599ce0c9e5ce11568cd87422e561db5a90fd8966e7e3ce79bf7064c243b38
Deleted: sha256:628d2d2f87c91168dcc7e5bff091e904fae7e3d0ca513898a1a389bcdba140c2
Deleted: sha256:801d56332ded2e6d126424e8d833b06613a6e323cee24687d1e96e788deaf1eb
Deleted: sha256:550bba1562254a5827402336161ffffc4174d70833255aac38fde4c4c3ae49b2
Deleted: sha256:f2376c27269d7655975c95366137060a50601a2ee9361bedbff768bce4b32b16
Deleted: sha256:b4c455932be21eafd849c9138be19fb7c864799e3698f94029ee6bc39ad91693
Deleted: sha256:7baf698e3e1ecbe0689b06ab0fed782be82ba134c529b65ae612b8b29fd6e2b4
Deleted: sha256:ac5459209fd33b45819f85c77bfa843c0d06b4df3dbde120dd477377ca1e5d2d
Deleted: sha256:8485648ac28569c498e790b3217cff71c40e8f0219e661465b6d3464f3105a60
Deleted: sha256:5648a2ae830a4b6aebb65d072f50026ee1ebfcd0b9d717307dafa3db3484f957
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-023152
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:70f3cf41ce413fd3a23536970b300da103d3f811a6b27790f2ee7f68914da45b
Associated tags:
- 20230328-023152
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-023152
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230328-023152].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:70f3cf41ce413fd3a23536970b300da103d3f811a6b27790f2ee7f68914da45b].
$ rm -rf /tmp/tmp.9I7RThmm6X
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328022050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fede81652d1c2d17e0ca79a59e03e67d16847e2f788aeaf54923764e9f0bf468
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328022050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fede81652d1c2d17e0ca79a59e03e67d16847e2f788aeaf54923764e9f0bf468]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230328022050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fede81652d1c2d17e0ca79a59e03e67d16847e2f788aeaf54923764e9f0bf468])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fede81652d1c2d17e0ca79a59e03e67d16847e2f788aeaf54923764e9f0bf468
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fede81652d1c2d17e0ca79a59e03e67d16847e2f788aeaf54923764e9f0bf468
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fede81652d1c2d17e0ca79a59e03e67d16847e2f788aeaf54923764e9f0bf468].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328022050
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5d848e561df45f2c12dc3c5f843850bb4399c9494a48d7ae646ba521b5978a4
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328022050]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5d848e561df45f2c12dc3c5f843850bb4399c9494a48d7ae646ba521b5978a4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230328022050] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5d848e561df45f2c12dc3c5f843850bb4399c9494a48d7ae646ba521b5978a4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5d848e561df45f2c12dc3c5f843850bb4399c9494a48d7ae646ba521b5978a4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5d848e561df45f2c12dc3c5f843850bb4399c9494a48d7ae646ba521b5978a4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5d848e561df45f2c12dc3c5f843850bb4399c9494a48d7ae646ba521b5978a4].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 678284.
Stopping expansion service pid: 678285.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 14s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ad7baeiiwdq3k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1454
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1454/display/redirect?page=changes>
Changes:
[noreply] Fix tfhub example + instructions (#25995)
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327202028",
"environmentId": "rzxbwPKuKKbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-203059"
}
]
},
"name": "go-testxlang_partition-805",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/27 21:17:07 Submitted job: 2023-03-27_14_17_06-11360846404271470334
2023/03/27 21:17:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-27_14_17_06-11360846404271470334?project=apache-beam-testing
2023/03/27 21:17:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-27_14_17_06-11360846404271470334
2023/03/27 21:17:07 Job state: JOB_STATE_PENDING ...
2023/03/27 21:17:37 Job still running ...
2023/03/27 21:18:07 Job still running ...
2023/03/27 21:18:37 Job still running ...
2023/03/27 21:19:07 Job still running ...
2023/03/27 21:19:37 Job still running ...
2023/03/27 21:20:07 Job still running ...
2023/03/27 21:20:37 Job still running ...
2023/03/27 21:21:07 Job still running ...
2023/03/27 21:21:37 Job still running ...
2023/03/27 21:22:08 Job still running ...
2023/03/27 21:22:38 Job still running ...
2023/03/27 21:23:08 Job still running ...
2023/03/27 21:23:38 Job still running ...
2023/03/27 21:24:08 Job still running ...
2023/03/27 21:24:38 Job still running ...
2023/03/27 21:25:08 Job still running ...
2023/03/27 21:25:38 Job still running ...
2023/03/27 21:26:08 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-27_14_17_06-11360846404271470334 failed
--- FAIL: TestXLang_Partition (581.20s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3307.215s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679949094547628127
--- FAIL: TestBigQueryIO_BasicWriteRead (4.66s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42475 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NFlOZzecPz" is_bounded:BOUNDED windowing_strategy_id:"w0@NFlOZzecPz"}} windowing_strategies:{key:"w0@NFlOZzecPz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NFlOZzecPz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NFlOZzecPz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NFlOZzecPz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679949094547628127\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NFlOZzecPz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42475 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@NFlOZzecPz" is_bounded:BOUNDED windowing_strategy_id:"w0@NFlOZzecPz"}} windowing_strategies:{key:"w0@NFlOZzecPz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@NFlOZzecPz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@NFlOZzecPz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@NFlOZzecPz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679949094547628127\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"NFlOZzecPz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 66 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000157580})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000157580})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000536680?, 0xc00054a000?}, {0x113b23e, 0x39}, {0xc00015a0c0?, 0xa9ea20?, 0x1?}, {0xc000610c90, 0xf}, 0xc00064fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000536620?, 0xc00054a000?}, {0xc00004c540, 0x52}, {0x1?}, {0xc00064fea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000610c90, 0xf}, {0xc00004c540, 0x52}, {0xebcb60, 0xc000538138})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000403040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000403040, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.694s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-203059
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-203059
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4841cf212b8efa6b53b5c9f0ee8bba21c5be00ff09b984b217d2bed236dffa62
Deleted: sha256:6641830682abb6ee7775b10dd39254cdeee2be91e0eae6b150898b6bdbb04e5e
Deleted: sha256:d3ef2b5672a33f43353ccd86fdb6ef5812b74d5332984191deef65ed83190560
Deleted: sha256:0d0286445558894770d375e9922b90ced9dae18af068fb275227b28c8b14a412
Deleted: sha256:893bf961ee7057130c4166c93b78b30393e3c6f8d5300d8662d7b1c1e1669080
Deleted: sha256:251917ecf2447a42419da0859a0ea9904f6e94b87ca03e50c388e0af03c1e5e9
Deleted: sha256:ec7f30454124a596a0b4a6a67aa74bd0f2392aecbb0ef521a3009940fc32042e
Deleted: sha256:0c30d0a32006c57a168efdc34cd3c577f4a3991144a7001541e54061ea4ee68d
Deleted: sha256:1a909aa5bc7db1849e8ed1bb1f1dcdda67fae3af851c6b03feb2dea5c3b02ff5
Deleted: sha256:cf381b38283d0dbce7976b9d788d64d3e18062a7a0ae8332d3d6348734e3fc87
Deleted: sha256:27e693a83191ec64fd8f5bc7b1d419d3ed380773c5a5bd4fb12484d93c315a20
Deleted: sha256:953b570a9177788d334cfd8ae1bd37e0ee1056f4b52e40519ca8f894ba108ba2
Deleted: sha256:45efe309e75b60c2adc2273da334b158075d83cdfe7e73b23617b0233d1b08fa
Deleted: sha256:4fec942a90d66d62b145e50781dbe0b3e987184b6c37ff49f33cee8f2a652b9e
Deleted: sha256:5225f221955e5e12ac3b38f441b7d02d397f609d5cf86663cfe908de104e0570
Deleted: sha256:d0977ece4ce43d9f9a4cf5fbd847f04735997cab27ce9c292ff4072f8f1e0b53
Deleted: sha256:1b4cb4c5169a4481f83c7a1a962e5011be9a3dc06dd418f75f056f9ea5ee539e
Deleted: sha256:475aa81007ed0e16b87b67c7a83babce91631ade12b3cd45b940d7230f557364
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-203059
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4841cf212b8efa6b53b5c9f0ee8bba21c5be00ff09b984b217d2bed236dffa62
Associated tags:
- 20230327-203059
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-203059
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-203059].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4841cf212b8efa6b53b5c9f0ee8bba21c5be00ff09b984b217d2bed236dffa62].
$ rm -rf /tmp/tmp.iEf3ASvTdd
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327202028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6dca2c964caa61defcc34e56cff27176fe146af62032c7ce4c963fd5f22cbed5
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327202028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6dca2c964caa61defcc34e56cff27176fe146af62032c7ce4c963fd5f22cbed5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327202028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6dca2c964caa61defcc34e56cff27176fe146af62032c7ce4c963fd5f22cbed5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6dca2c964caa61defcc34e56cff27176fe146af62032c7ce4c963fd5f22cbed5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6dca2c964caa61defcc34e56cff27176fe146af62032c7ce4c963fd5f22cbed5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6dca2c964caa61defcc34e56cff27176fe146af62032c7ce4c963fd5f22cbed5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327202028
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ca21f7757fc8319501aa0fd4a26b17abe5d511ca22110df9328e83cf3444c8c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327202028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ca21f7757fc8319501aa0fd4a26b17abe5d511ca22110df9328e83cf3444c8c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327202028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ca21f7757fc8319501aa0fd4a26b17abe5d511ca22110df9328e83cf3444c8c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ca21f7757fc8319501aa0fd4a26b17abe5d511ca22110df9328e83cf3444c8c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ca21f7757fc8319501aa0fd4a26b17abe5d511ca22110df9328e83cf3444c8c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ca21f7757fc8319501aa0fd4a26b17abe5d511ca22110df9328e83cf3444c8c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 371233.
Stopping expansion service pid: 371234.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 36s
232 actionable tasks: 154 executed, 66 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ung57nvaexn5o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1453
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1453/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-143100",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327142038",
"environmentId": "aykFDzIdDHbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-143100"
}
]
},
"name": "go-testxlang_partition-970",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/27 15:17:45 Submitted job: 2023-03-27_08_17_45-13247880786544831742
2023/03/27 15:17:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-27_08_17_45-13247880786544831742?project=apache-beam-testing
2023/03/27 15:17:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-27_08_17_45-13247880786544831742
2023/03/27 15:17:45 Job state: JOB_STATE_PENDING ...
2023/03/27 15:18:15 Job still running ...
2023/03/27 15:18:45 Job still running ...
2023/03/27 15:19:16 Job still running ...
2023/03/27 15:19:46 Job still running ...
2023/03/27 15:20:16 Job still running ...
2023/03/27 15:20:46 Job still running ...
2023/03/27 15:21:16 Job still running ...
2023/03/27 15:21:46 Job still running ...
2023/03/27 15:22:16 Job still running ...
2023/03/27 15:22:46 Job still running ...
2023/03/27 15:23:16 Job still running ...
2023/03/27 15:23:46 Job still running ...
2023/03/27 15:24:16 Job still running ...
2023/03/27 15:24:46 Job still running ...
2023/03/27 15:25:16 Job still running ...
2023/03/27 15:25:46 Job still running ...
2023/03/27 15:26:16 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-27_08_17_45-13247880786544831742 failed
--- FAIL: TestXLang_Partition (553.90s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3314.095s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679927495803492291
--- FAIL: TestBigQueryIO_BasicWriteRead (4.42s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45729 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@zbhYHLokfP" is_bounded:BOUNDED windowing_strategy_id:"w0@zbhYHLokfP"}} windowing_strategies:{key:"w0@zbhYHLokfP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@zbhYHLokfP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@zbhYHLokfP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@zbhYHLokfP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679927495803492291\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"zbhYHLokfP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45729 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@zbhYHLokfP" is_bounded:BOUNDED windowing_strategy_id:"w0@zbhYHLokfP"}} windowing_strategies:{key:"w0@zbhYHLokfP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@zbhYHLokfP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@zbhYHLokfP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@zbhYHLokfP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679927495803492291\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"zbhYHLokfP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 56 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0001ceb00})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0001ceb00})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a7280?, 0xc000416050?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc000403020, 0xf}, 0xc00015fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a7220?, 0xc000416050?}, {0xc000138300, 0x52}, {0x1?}, {0xc00015fea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000403020, 0xf}, {0xc000138300, 0x52}, {0xebcb60, 0xc0001241c8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000582ea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000582ea0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.457s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3f6049b1ddde3a061adabf69d79c47af650941b7d4d4071cb92fa21ceab6d089
Associated tags:
- 20230327-143100
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-143100
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-143100].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3f6049b1ddde3a061adabf69d79c47af650941b7d4d4071cb92fa21ceab6d089].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7c26e192089e7535b0a8da6296ac3ecb8ebdab127a00e3c5bbe5f3505b1ce026]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7c26e192089e7535b0a8da6296ac3ecb8ebdab127a00e3c5bbe5f3505b1ce026])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7c26e192089e7535b0a8da6296ac3ecb8ebdab127a00e3c5bbe5f3505b1ce026
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7c26e192089e7535b0a8da6296ac3ecb8ebdab127a00e3c5bbe5f3505b1ce026].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327142038]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d49830e67dc9a8ef1fcac53dd4d359dca81176bcfb531e1f9a2ace2fc0511340]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327142038] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d49830e67dc9a8ef1fcac53dd4d359dca81176bcfb531e1f9a2ace2fc0511340])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d49830e67dc9a8ef1fcac53dd4d359dca81176bcfb531e1f9a2ace2fc0511340
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d49830e67dc9a8ef1fcac53dd4d359dca81176bcfb531e1f9a2ace2fc0511340].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 35s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/qs7vfajsppkzk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1452
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1452/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-083147",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-083147"
}
]
},
"name": "go-testxlang_partition-828",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/27 09:17:28 Submitted job: 2023-03-27_02_17_27-13153756639286056615
2023/03/27 09:17:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-27_02_17_27-13153756639286056615?project=apache-beam-testing
2023/03/27 09:17:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-27_02_17_27-13153756639286056615
2023/03/27 09:17:28 Job state: JOB_STATE_PENDING ...
2023/03/27 09:17:58 Job still running ...
2023/03/27 09:18:28 Job still running ...
2023/03/27 09:18:58 Job still running ...
2023/03/27 09:19:28 Job still running ...
2023/03/27 09:19:58 Job still running ...
2023/03/27 09:20:28 Job still running ...
2023/03/27 09:20:58 Job still running ...
2023/03/27 09:21:28 Job still running ...
2023/03/27 09:21:58 Job still running ...
2023/03/27 09:22:28 Job still running ...
2023/03/27 09:22:58 Job still running ...
2023/03/27 09:23:29 Job still running ...
2023/03/27 09:23:59 Job still running ...
2023/03/27 09:24:29 Job still running ...
2023/03/27 09:24:59 Job still running ...
2023/03/27 09:25:29 Job still running ...
2023/03/27 09:25:59 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-27_02_17_27-13153756639286056615 failed
--- FAIL: TestXLang_Partition (550.45s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3245.026s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679905947440812860
--- FAIL: TestBigQueryIO_BasicWriteRead (4.84s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34001 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@mUdcxYBUnl" is_bounded:BOUNDED windowing_strategy_id:"w0@mUdcxYBUnl"}} windowing_strategies:{key:"w0@mUdcxYBUnl" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@mUdcxYBUnl" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@mUdcxYBUnl" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@mUdcxYBUnl" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679905947440812860\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"mUdcxYBUnl"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34001 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@mUdcxYBUnl" is_bounded:BOUNDED windowing_strategy_id:"w0@mUdcxYBUnl"}} windowing_strategies:{key:"w0@mUdcxYBUnl" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@mUdcxYBUnl" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@mUdcxYBUnl" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@mUdcxYBUnl" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679905947440812860\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"mUdcxYBUnl"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 23 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000278100})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000278100})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000408ea0?, 0xc000135770?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc000410ca0, 0xf}, 0xc000567d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000408e40?, 0xc000135770?}, {0xc00004ca80, 0x52}, {0x1?}, {0xc000567ea8, 0x2, 0x7f03f5c9b9e8?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000410ca0, 0xf}, {0xc00004ca80, 0x52}, {0xebcb60, 0xc000411fb0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103a00, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.871s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.041s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.041s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-083147
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-083147
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:dcaa1b6ecfd0d2388b7e9c78ade199900e4c67320957ce0289d8df0a0f291196
Deleted: sha256:5e9107f3c65e047f3566e01d0259cad00535fa06f3199216ad58018a18378133
Deleted: sha256:428cddc7395857883813579a0637ee53d0174108e953eea6933e57d003b3786a
Deleted: sha256:14869f32b07f3c80c62fe7fe95bdd020265409ffd152b70c891ec18c56918f58
Deleted: sha256:4fd3e6b2a2549f8272b0fcd7bb055e9357d0c37ff18aeff7346accccb06d4d4a
Deleted: sha256:fcf1b433f8441c00956adc2764a029ac3ef59715c3d3aff84ccc5b342be090e5
Deleted: sha256:7ff1f816c0d31382932defe5d815c84fd311fe6a24ab82485b298c6b6772b2c8
Deleted: sha256:0774b0abe7cd8ca67a03b30948f4bc2717adcb0a4df76b20bfbd9acd31b49c21
Deleted: sha256:8bda9fb65cf258c2a71b05cbd2e2bf9e8c364779ea79f1f876c13be897edf8d6
Deleted: sha256:a1f8832f42c073350ddd9e41963d6152f650d29e411d75e4a8698a27711f6615
Deleted: sha256:4d7e6e8c1912d2e5558840318c0e2ca2dbea2dd2d006ded9ea7c7e8d49e2d653
Deleted: sha256:3422ca954b1a97dcd395f664408ce0fca2ece2d927bd6d4c6f685ebc6d57625d
Deleted: sha256:f8491d2312b8e05d72537c3eb930e74221035da881ba3a1bc77d27921a747e3b
Deleted: sha256:b1e50fbb2bfe6049e368326caeca2dd16ca26b24d694dfb399479b037893a8b2
Deleted: sha256:877b896056aee0f148c22ffb6cf7c908c04a25dda678a89b93a0227b0d85f14d
Deleted: sha256:7ab3e314e49f4b98e06388492976cec09d2eb050500550419909ee15577f9685
Deleted: sha256:659324f7282dddd21dabb4e7e4f3777099f0f9470cb53944ced9fc1f67ec2107
Deleted: sha256:0ab33a708a4bb2f6e5b76842fdfc9a7aea96b1a738f812424d3a06c6a52756c0
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-083147
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:dcaa1b6ecfd0d2388b7e9c78ade199900e4c67320957ce0289d8df0a0f291196
Associated tags:
- 20230327-083147
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-083147
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-083147].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:dcaa1b6ecfd0d2388b7e9c78ade199900e4c67320957ce0289d8df0a0f291196].
$ rm -rf /tmp/tmp.NwaVjAti9A
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62166a5ac5c658108c1c942e45b5651055e479da967f0291f3dc41bde3df0dd8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62166a5ac5c658108c1c942e45b5651055e479da967f0291f3dc41bde3df0dd8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62166a5ac5c658108c1c942e45b5651055e479da967f0291f3dc41bde3df0dd8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62166a5ac5c658108c1c942e45b5651055e479da967f0291f3dc41bde3df0dd8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62166a5ac5c658108c1c942e45b5651055e479da967f0291f3dc41bde3df0dd8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:62166a5ac5c658108c1c942e45b5651055e479da967f0291f3dc41bde3df0dd8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327082040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8e15f98bc94418a023a1dc9ab9cb215537818c014a915315f5ab4ea8d47c1d81
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327082040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8e15f98bc94418a023a1dc9ab9cb215537818c014a915315f5ab4ea8d47c1d81]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327082040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8e15f98bc94418a023a1dc9ab9cb215537818c014a915315f5ab4ea8d47c1d81])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8e15f98bc94418a023a1dc9ab9cb215537818c014a915315f5ab4ea8d47c1d81
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8e15f98bc94418a023a1dc9ab9cb215537818c014a915315f5ab4ea8d47c1d81
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8e15f98bc94418a023a1dc9ab9cb215537818c014a915315f5ab4ea8d47c1d81].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3444213.
Stopping expansion service pid: 3444214.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 15s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/662amksytojg4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1451
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1451/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-023055",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327022041",
"environmentId": "HfCWEdgHrPbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-023055"
}
]
},
"name": "go-testxlang_partition-239",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/27 03:15:24 Submitted job: 2023-03-26_20_15_23-9791852426034797756
2023/03/27 03:15:24 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-26_20_15_23-9791852426034797756?project=apache-beam-testing
2023/03/27 03:15:24 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-26_20_15_23-9791852426034797756
2023/03/27 03:15:24 Job state: JOB_STATE_PENDING ...
2023/03/27 03:15:54 Job still running ...
2023/03/27 03:16:24 Job still running ...
2023/03/27 03:16:54 Job still running ...
2023/03/27 03:17:24 Job still running ...
2023/03/27 03:17:54 Job still running ...
2023/03/27 03:18:24 Job still running ...
2023/03/27 03:18:54 Job still running ...
2023/03/27 03:19:24 Job still running ...
2023/03/27 03:19:54 Job still running ...
2023/03/27 03:20:24 Job still running ...
2023/03/27 03:20:54 Job still running ...
2023/03/27 03:21:24 Job still running ...
2023/03/27 03:21:54 Job still running ...
2023/03/27 03:22:24 Job still running ...
2023/03/27 03:22:54 Job still running ...
2023/03/27 03:23:24 Job still running ...
2023/03/27 03:23:55 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-26_20_15_23-9791852426034797756 failed
--- FAIL: TestXLang_Partition (550.31s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3177.365s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679884291260968778
--- FAIL: TestBigQueryIO_BasicWriteRead (4.66s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41039 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kuLOfkFjUP" is_bounded:BOUNDED windowing_strategy_id:"w0@kuLOfkFjUP"}} windowing_strategies:{key:"w0@kuLOfkFjUP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kuLOfkFjUP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kuLOfkFjUP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kuLOfkFjUP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679884291260968778\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kuLOfkFjUP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41039 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@kuLOfkFjUP" is_bounded:BOUNDED windowing_strategy_id:"w0@kuLOfkFjUP"}} windowing_strategies:{key:"w0@kuLOfkFjUP" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@kuLOfkFjUP" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@kuLOfkFjUP" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@kuLOfkFjUP" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679884291260968778\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"kuLOfkFjUP"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000692d40})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000692d40})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00040e600?, 0xc0001142d0?}, {0x113b23e, 0x39}, {0xc00015c0c0?, 0xa9ea20?, 0x1?}, {0xc000043070, 0xf}, 0xc0006abd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00040e5a0?, 0xc0001142d0?}, {0xc00004c5a0, 0x52}, {0x1?}, {0xc0006abea8, 0x2, 0x7f1f88985e68?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000043070, 0xf}, {0xc00004c5a0, 0x52}, {0xebcb60, 0xc0004101b0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000529380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000529380, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.695s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.033s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3f3f9ed2f19f0e01fdc819c811bec713bf595f9997509e2c585597c36d9a7c00
Associated tags:
- 20230327-023055
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-023055
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230327-023055].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3f3f9ed2f19f0e01fdc819c811bec713bf595f9997509e2c585597c36d9a7c00].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73ead4551adea8d007a46a3e75de667b9669b242150e9da95f4ebd16792c0bb6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230327022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73ead4551adea8d007a46a3e75de667b9669b242150e9da95f4ebd16792c0bb6])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73ead4551adea8d007a46a3e75de667b9669b242150e9da95f4ebd16792c0bb6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:73ead4551adea8d007a46a3e75de667b9669b242150e9da95f4ebd16792c0bb6].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a60487775c00fd6077539cedd2b5890286aef658986bfbefb14e220adbcb3875]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230327022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a60487775c00fd6077539cedd2b5890286aef658986bfbefb14e220adbcb3875])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a60487775c00fd6077539cedd2b5890286aef658986bfbefb14e220adbcb3875
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a60487775c00fd6077539cedd2b5890286aef658986bfbefb14e220adbcb3875].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 10s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/y7ldunb7nlgcs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1450
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1450/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326202041",
"environmentId": "fNzxYhUmBLbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-203208"
}
]
},
"name": "go-testxlang_partition-674",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/26 21:17:41 Submitted job: 2023-03-26_14_17_41-8320540947130749659
2023/03/26 21:17:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-26_14_17_41-8320540947130749659?project=apache-beam-testing
2023/03/26 21:17:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-26_14_17_41-8320540947130749659
2023/03/26 21:17:41 Job state: JOB_STATE_PENDING ...
2023/03/26 21:18:11 Job still running ...
2023/03/26 21:18:41 Job still running ...
2023/03/26 21:19:11 Job still running ...
2023/03/26 21:19:41 Job still running ...
2023/03/26 21:20:11 Job still running ...
2023/03/26 21:20:41 Job still running ...
2023/03/26 21:21:12 Job still running ...
2023/03/26 21:21:42 Job still running ...
2023/03/26 21:22:12 Job still running ...
2023/03/26 21:22:42 Job still running ...
2023/03/26 21:23:12 Job still running ...
2023/03/26 21:23:42 Job still running ...
2023/03/26 21:24:12 Job still running ...
2023/03/26 21:24:42 Job still running ...
2023/03/26 21:25:12 Job still running ...
2023/03/26 21:25:42 Job still running ...
2023/03/26 21:26:12 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-26_14_17_41-8320540947130749659 failed
--- FAIL: TestXLang_Partition (550.87s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3240.476s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679862765285034851
--- FAIL: TestBigQueryIO_BasicWriteRead (4.63s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36283 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dlwYSXibCg" is_bounded:BOUNDED windowing_strategy_id:"w0@dlwYSXibCg"}} windowing_strategies:{key:"w0@dlwYSXibCg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dlwYSXibCg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dlwYSXibCg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dlwYSXibCg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679862765285034851\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dlwYSXibCg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36283 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@dlwYSXibCg" is_bounded:BOUNDED windowing_strategy_id:"w0@dlwYSXibCg"}} windowing_strategies:{key:"w0@dlwYSXibCg" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@dlwYSXibCg" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@dlwYSXibCg" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@dlwYSXibCg" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679862765285034851\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"dlwYSXibCg"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000111640})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000111640})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004080a0?, 0xc00044e000?}, {0x113b23e, 0x39}, {0xc00045c000?, 0xa9ea20?, 0x1?}, {0xc0004ecba0, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000408020?, 0xc00044e000?}, {0xc0001167e0, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0004ecba0, 0xf}, {0xc0001167e0, 0x52}, {0xebcb60, 0xc00040c1a8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001ac9c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001ac9c0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.662s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.037s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-203208
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-203208
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:20af3015ae8edc81f04f172140593688ffb0c0708b8503455573d418652bb621
Deleted: sha256:e838197f65943bfd5a819ea39f34343a4dbf15459e51d43e3cad2f42a2402f24
Deleted: sha256:a8d12e3babc0901346884ba1af91f6ebedce07c9275d3817ddd22b232b9ea284
Deleted: sha256:c3a413b7af628390e8215561003f5301b849b804e7b25fb3ab3bd245a0c4340c
Deleted: sha256:f784840d9eb2571300c88db67032ad1f0505530579ad56b1661ac23d737caee2
Deleted: sha256:66cc901f40ed9e023a12dbf452bf57275a61e027b931cc94a97438dcac9c188f
Deleted: sha256:1720d9a158759c1b5d3993c090ace4609307edaae18c33bf65fe88260c11462c
Deleted: sha256:e0e765c8ebba4299b4fe1bbf32e64812e6a489a1bc171adefd7da388a00ac38e
Deleted: sha256:ba6bf49bf692d3af0a1baf37e61f58679d41eabc5d1f2f26edc5f808f4a7dc0d
Deleted: sha256:fbef254850e1e4237c923161f72da5303825b9c7e0a4d46cdf40cfac5b9803f0
Deleted: sha256:c44b9bcb3eca1c9f33fb5e09ebba1db620159962d83e37647d537ca5acd323f5
Deleted: sha256:6fdf9d72358352c3f85d15983e4ae695340a6e6e2936e5b90ff0368bcb1f5886
Deleted: sha256:5181394af3329980cc5db51451579b7f88b3d2b2efbac5560aa8d19f4a4216ad
Deleted: sha256:107b77dc28353526ea0d90bbc096ed69a0cd394f87d7f29a85f840f67dcdff6c
Deleted: sha256:79e0ea279b333d0cba0c22cc36369b5eb0d53fbed448a69ac6ab6d4220651ae9
Deleted: sha256:cf2f50642e8f29b7a364f1a678ce7c79f4bf72082ce6e5eef949d1640bffec34
Deleted: sha256:7957fb89a85b2f6900600730ae6021b08c1a187ad337f19bde23b830f11f8671
Deleted: sha256:f1e53ac08401ec18313d46212858d5cb549e856442c62dedbbe82801985e7ed8
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-203208
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:20af3015ae8edc81f04f172140593688ffb0c0708b8503455573d418652bb621
Associated tags:
- 20230326-203208
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-203208
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-203208].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:20af3015ae8edc81f04f172140593688ffb0c0708b8503455573d418652bb621].
$ rm -rf /tmp/tmp.WWDJ2ekQrn
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326202041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e16c86adb209a018e2c45b78c127adbd76c188cd4e6525353240fb5b9d67d7dd
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e16c86adb209a018e2c45b78c127adbd76c188cd4e6525353240fb5b9d67d7dd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e16c86adb209a018e2c45b78c127adbd76c188cd4e6525353240fb5b9d67d7dd])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e16c86adb209a018e2c45b78c127adbd76c188cd4e6525353240fb5b9d67d7dd
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e16c86adb209a018e2c45b78c127adbd76c188cd4e6525353240fb5b9d67d7dd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e16c86adb209a018e2c45b78c127adbd76c188cd4e6525353240fb5b9d67d7dd].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326202041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136e582a45f72d87903d78fd3d3e30a6518b306a2d473ec231d0bac413ee02
Deleted: sha256:86405df63cb9df582e2dc094ad07f9de368f3083f55b67c73674c512160827ac
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136e582a45f72d87903d78fd3d3e30a6518b306a2d473ec231d0bac413ee02]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136e582a45f72d87903d78fd3d3e30a6518b306a2d473ec231d0bac413ee02])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136e582a45f72d87903d78fd3d3e30a6518b306a2d473ec231d0bac413ee02
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136e582a45f72d87903d78fd3d3e30a6518b306a2d473ec231d0bac413ee02
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136e582a45f72d87903d78fd3d3e30a6518b306a2d473ec231d0bac413ee02].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2992755.
Stopping expansion service pid: 2992756.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 26s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/vz3djg67zmqig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1449
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1449/display/redirect>
Changes:
------------------------------------------
[...truncated 1019.64 KB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-142805",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-142805"
}
]
},
"name": "go-testxlang_partition-633",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/26 15:13:11 Submitted job: 2023-03-26_08_13_10-12944461804618405893
2023/03/26 15:13:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-26_08_13_10-12944461804618405893?project=apache-beam-testing
2023/03/26 15:13:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-26_08_13_10-12944461804618405893
2023/03/26 15:13:11 Job state: JOB_STATE_PENDING ...
2023/03/26 15:13:41 Job still running ...
2023/03/26 15:14:11 Job still running ...
2023/03/26 15:14:41 Job still running ...
2023/03/26 15:15:11 Job still running ...
2023/03/26 15:15:41 Job still running ...
2023/03/26 15:16:11 Job still running ...
2023/03/26 15:16:41 Job still running ...
2023/03/26 15:17:11 Job still running ...
2023/03/26 15:17:41 Job still running ...
2023/03/26 15:18:11 Job still running ...
2023/03/26 15:18:41 Job still running ...
2023/03/26 15:19:11 Job still running ...
2023/03/26 15:19:41 Job still running ...
2023/03/26 15:20:11 Job still running ...
2023/03/26 15:20:41 Job still running ...
2023/03/26 15:21:11 Job still running ...
2023/03/26 15:21:41 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-26_08_13_10-12944461804618405893 failed
--- FAIL: TestXLang_Partition (552.64s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3213.424s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679840921744808931
--- FAIL: TestBigQueryIO_BasicWriteRead (4.47s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38755 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RfbheQZVPX" is_bounded:BOUNDED windowing_strategy_id:"w0@RfbheQZVPX"}} windowing_strategies:{key:"w0@RfbheQZVPX" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RfbheQZVPX" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RfbheQZVPX" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RfbheQZVPX" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679840921744808931\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RfbheQZVPX"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38755 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RfbheQZVPX" is_bounded:BOUNDED windowing_strategy_id:"w0@RfbheQZVPX"}} windowing_strategies:{key:"w0@RfbheQZVPX" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RfbheQZVPX" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RfbheQZVPX" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RfbheQZVPX" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679840921744808931\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RfbheQZVPX"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000026800})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000026800})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001e13a0?, 0xc0001b19a0?}, {0x113b23e, 0x39}, {0xc0001d20c0?, 0xa9ea20?, 0x1?}, {0xc0001a9580, 0xf}, 0xc000177d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0001e1340?, 0xc0001b19a0?}, {0xc00013c3c0, 0x52}, {0x1?}, {0xc000177ea8, 0x2, 0x7f5e545e4b00?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0001a9580, 0xf}, {0xc00013c3c0, 0x52}, {0xebcb60, 0xc00017a890})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000102d00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000102d00, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.501s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-142805
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-142805
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:68cb47136007fccca896a99cf8d321703fa42b250a85e6cf28c84499522be5e7
Deleted: sha256:480d7f4d0df32760ae539501a31a0d150224aa11f1575aea19397561b126634b
Deleted: sha256:d914497569b805f6cb1dd99b38e5850a5dd560632da5a6603efc5cc135c77b41
Deleted: sha256:60d0bf9b81e11b41eb23b63b38f912ad095409aacb954c9dbbf5bc4726c9219f
Deleted: sha256:f0f0161ab513256129672420af3116aad9e56d5d04af85413fc2adac889c9e15
Deleted: sha256:84e6c5c543714b95c0016a2abc186fef72969daa872bdd5b7e8e33e06b229ea6
Deleted: sha256:7cbdd42835039e712436b77428475c658467cd7e0dbf819cb00751b124b10ac7
Deleted: sha256:dcf84f07b4aa8ab23c9fdcf5aac2c3667c0d7cf486b8662dcec37b8ba3d35ae7
Deleted: sha256:e9051f5dd2f020b5f530a88b5bd00f436ff78e6e20cf88773533eefae3dd492d
Deleted: sha256:7de99f9eeb4973022ed21267d1cffe7058ed2e7b8e766b83c7b8403bafc4384d
Deleted: sha256:7d7224ebc297da54dd4651f16223a4ff4b0440e62f02c26a6877aa42572aa17d
Deleted: sha256:076b21cbea1643008f62ac25c98c7bd38ce5eaaddaf503c3dc5739035b3691b9
Deleted: sha256:f001a02c0c44d8479c4e441c679a8b6a0c8f47f2b42053e0f6e9849a5f8856e1
Deleted: sha256:902d241133ec1d00772619282a15a12d0d76055b05b2c92063d9b30103e0b515
Deleted: sha256:a8531f1f7dc5825245e03665cee772531549ce7a3cc7131aa7cbcd7cb9a63654
Deleted: sha256:ff66dd737c531fb062e022017316c9502cca6b270c4933b5007ef85ea932a619
Deleted: sha256:102769e54809e364bfb8e57f3fec065e81838c913188f628d49a8571027d344a
Deleted: sha256:2eca8879bb18e2aaa112997fee8855d75ae35acf0ba0b795cfe1246059069fa8
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-142805
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:68cb47136007fccca896a99cf8d321703fa42b250a85e6cf28c84499522be5e7
Associated tags:
- 20230326-142805
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-142805
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-142805].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:68cb47136007fccca896a99cf8d321703fa42b250a85e6cf28c84499522be5e7].
$ rm -rf /tmp/tmp.NU2BW6GR2r
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fae4fb1d250093395e41da1b546dcdfa0d083e7b0ddd745bbb1214b8a7dcaddc
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fae4fb1d250093395e41da1b546dcdfa0d083e7b0ddd745bbb1214b8a7dcaddc]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fae4fb1d250093395e41da1b546dcdfa0d083e7b0ddd745bbb1214b8a7dcaddc])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fae4fb1d250093395e41da1b546dcdfa0d083e7b0ddd745bbb1214b8a7dcaddc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fae4fb1d250093395e41da1b546dcdfa0d083e7b0ddd745bbb1214b8a7dcaddc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:fae4fb1d250093395e41da1b546dcdfa0d083e7b0ddd745bbb1214b8a7dcaddc].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eceaf1d695bd335722a0e6a44e5fb4eec1b68df65919ddcc5553f6526bd26699
Deleted: sha256:88344237cd99448b0b67daef94f53cd70161c3b6c63060871cd129b1bfcdaead
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eceaf1d695bd335722a0e6a44e5fb4eec1b68df65919ddcc5553f6526bd26699]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eceaf1d695bd335722a0e6a44e5fb4eec1b68df65919ddcc5553f6526bd26699])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eceaf1d695bd335722a0e6a44e5fb4eec1b68df65919ddcc5553f6526bd26699
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eceaf1d695bd335722a0e6a44e5fb4eec1b68df65919ddcc5553f6526bd26699
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eceaf1d695bd335722a0e6a44e5fb4eec1b68df65919ddcc5553f6526bd26699].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2876769.
Stopping expansion service pid: 2876770.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 2m 10s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/bn3ksn3rnvepg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1448
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1448/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-083048",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326082028",
"environmentId": "egnXcvczQSbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-083048"
}
]
},
"name": "go-testxlang_partition-299",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/26 09:15:52 Submitted job: 2023-03-26_02_15_51-13166386328982084408
2023/03/26 09:15:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-26_02_15_51-13166386328982084408?project=apache-beam-testing
2023/03/26 09:15:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-26_02_15_51-13166386328982084408
2023/03/26 09:15:52 Job state: JOB_STATE_PENDING ...
2023/03/26 09:16:22 Job still running ...
2023/03/26 09:16:52 Job still running ...
2023/03/26 09:17:22 Job still running ...
2023/03/26 09:17:52 Job still running ...
2023/03/26 09:18:22 Job still running ...
2023/03/26 09:18:52 Job still running ...
2023/03/26 09:19:22 Job still running ...
2023/03/26 09:19:52 Job still running ...
2023/03/26 09:20:22 Job still running ...
2023/03/26 09:20:52 Job still running ...
2023/03/26 09:21:23 Job still running ...
2023/03/26 09:21:53 Job still running ...
2023/03/26 09:22:23 Job still running ...
2023/03/26 09:22:53 Job still running ...
2023/03/26 09:23:23 Job still running ...
2023/03/26 09:23:53 Job still running ...
2023/03/26 09:24:23 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-26_02_15_51-13166386328982084408 failed
--- FAIL: TestXLang_Partition (551.07s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3210.846s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679819485754526762
--- FAIL: TestBigQueryIO_BasicWriteRead (5.53s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38447 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@obZQewOpAT" is_bounded:BOUNDED windowing_strategy_id:"w0@obZQewOpAT"}} windowing_strategies:{key:"w0@obZQewOpAT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@obZQewOpAT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@obZQewOpAT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@obZQewOpAT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679819485754526762\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"obZQewOpAT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:38447 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@obZQewOpAT" is_bounded:BOUNDED windowing_strategy_id:"w0@obZQewOpAT"}} windowing_strategies:{key:"w0@obZQewOpAT" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@obZQewOpAT" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@obZQewOpAT" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@obZQewOpAT" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679819485754526762\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"obZQewOpAT"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 54 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000510940})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000510940})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000169aa0?, 0xc0000e1680?}, {0x113b23e, 0x39}, {0xc00015e0c0?, 0xa9ea20?, 0x1?}, {0xc00050ed90, 0xf}, 0xc000159d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000169a40?, 0xc0000e1680?}, {0xc00004c540, 0x52}, {0x1?}, {0xc000159ea8, 0x2, 0x7f1efda2a180?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00050ed90, 0xf}, {0xc00004c540, 0x52}, {0xebcb60, 0xc00057e0a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0002ff380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0002ff380, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.588s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.075s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.060s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e522f0a698d79bc6595b49d734dc38232866f1430f68b7182462f677e8f89a52
Associated tags:
- 20230326-083048
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-083048
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-083048].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e522f0a698d79bc6595b49d734dc38232866f1430f68b7182462f677e8f89a52].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1669ce797e734673d44aa739405ae19fd07ebddbb66c80fabcf64ac80255de60]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1669ce797e734673d44aa739405ae19fd07ebddbb66c80fabcf64ac80255de60])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1669ce797e734673d44aa739405ae19fd07ebddbb66c80fabcf64ac80255de60
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1669ce797e734673d44aa739405ae19fd07ebddbb66c80fabcf64ac80255de60].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326082028]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0307e73a572fb95b41bd821149d0b038788fbdc6e4c388261cc7b46235425627]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326082028] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0307e73a572fb95b41bd821149d0b038788fbdc6e4c388261cc7b46235425627])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0307e73a572fb95b41bd821149d0b038788fbdc6e4c388261cc7b46235425627
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0307e73a572fb95b41bd821149d0b038788fbdc6e4c388261cc7b46235425627].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 4m 50s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/x5uudekqlwfq6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1447
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1447/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326022041",
"environmentId": "aiNiUIwybbbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-023126"
}
]
},
"name": "go-testxlang_partition-673",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/26 03:15:59 Submitted job: 2023-03-25_20_15_58-11305940046267834889
2023/03/26 03:15:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-25_20_15_58-11305940046267834889?project=apache-beam-testing
2023/03/26 03:15:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-25_20_15_58-11305940046267834889
2023/03/26 03:15:59 Job state: JOB_STATE_PENDING ...
2023/03/26 03:16:29 Job still running ...
2023/03/26 03:16:59 Job still running ...
2023/03/26 03:17:29 Job still running ...
2023/03/26 03:17:59 Job still running ...
2023/03/26 03:18:29 Job still running ...
2023/03/26 03:18:59 Job still running ...
2023/03/26 03:19:29 Job still running ...
2023/03/26 03:19:59 Job still running ...
2023/03/26 03:20:29 Job still running ...
2023/03/26 03:20:59 Job still running ...
2023/03/26 03:21:30 Job still running ...
2023/03/26 03:22:00 Job still running ...
2023/03/26 03:22:30 Job still running ...
2023/03/26 03:23:00 Job still running ...
2023/03/26 03:23:30 Job still running ...
2023/03/26 03:24:00 Job still running ...
2023/03/26 03:24:30 Job still running ...
2023/03/26 03:25:00 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-25_20_15_58-11305940046267834889 failed
--- FAIL: TestXLang_Partition (580.54s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3209.902s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679797923711558411
--- FAIL: TestBigQueryIO_BasicWriteRead (4.61s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36259 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YMaSnqCxZu" is_bounded:BOUNDED windowing_strategy_id:"w0@YMaSnqCxZu"}} windowing_strategies:{key:"w0@YMaSnqCxZu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YMaSnqCxZu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YMaSnqCxZu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YMaSnqCxZu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679797923711558411\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YMaSnqCxZu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36259 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@YMaSnqCxZu" is_bounded:BOUNDED windowing_strategy_id:"w0@YMaSnqCxZu"}} windowing_strategies:{key:"w0@YMaSnqCxZu" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@YMaSnqCxZu" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@YMaSnqCxZu" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@YMaSnqCxZu" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679797923711558411\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"YMaSnqCxZu"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 8 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0005a8940})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0005a8940})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003e2ca0?, 0xc0000bd9f0?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc000122fe0, 0xf}, 0xc000167d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003e2c40?, 0xc0000bd9f0?}, {0xc0004b03c0, 0x52}, {0x1?}, {0xc000167ea8, 0x2, 0x7fec9c0b4c30?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000122fe0, 0xf}, {0xc0004b03c0, 0x52}, {0xebcb60, 0xc0000ea320})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e0820)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e0820, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.639s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-023126
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-023126
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ce20d87052224d56c1719cbbbf7013caa744a1118ae818b1cabea2cf36ac4cb6
Deleted: sha256:39bfca4fd7933e6bac6e389daf81d65c7ad7c3a15ca8d7248a01b1e848b4b322
Deleted: sha256:61d6a2986cdba1f698e6594d51ffd4abfb16e65e813c5547b6bf39f249a7f88b
Deleted: sha256:ba667552bd15822d4e379bd153b1745d2ee855e9b3176676027624c77743aa18
Deleted: sha256:2b953e60516b319916ca11ce545d97908ee83f0895590b90e9f4c5f52e0fb6ad
Deleted: sha256:e3b9360aa7d2810af9dd351d58c387f38f0d4a76ebcf7deae10746ecfe8ef290
Deleted: sha256:aac672279ccc29f2254b8aaf592d1a695977b522ec7308510fe88904314cd03b
Deleted: sha256:0323fd9fd69f46058388461c8170f2703d7ffc899159e1d7e45ef1c835e6f937
Deleted: sha256:abd1fe4900f77cc4b916cdeeebab950450d5d46a7e573cb4968b963e7af279e4
Deleted: sha256:f97cf564806ffd683ab6d4de0743e834a9263555491c8e4df73aa021d1366230
Deleted: sha256:ef131c9d2afd6be4892eeedaaffa36ffbca886a9d7f7b69fdb0d4939e22ab07b
Deleted: sha256:6f524ec254e10f704fae0cdab1c50de4848ee201f361c568b3db656cf4192285
Deleted: sha256:d7c8c509e6a812e9d0ca1285783d2317d3683cf237b1aa00a13e998bc4b2ed20
Deleted: sha256:960a018042a86066aa8b29fd11c9769277adfc18a3dde9ebeda55b772e1c3f8d
Deleted: sha256:456098b295866da7df72127e720f921adf5a86a7318705f29a1ddbc683d91a8c
Deleted: sha256:49a8110654dbb59bc449cc070298f21e4928ecf06487ff5fe707c1bd9f226c50
Deleted: sha256:a114d71ea9c598cbedca7da753802691e63ddfe8d54e4fba0a26692f2d2aa9ae
Deleted: sha256:3863c75be7034682896de2b78c7b2d293d0ddf4c96aeab15d25cb5bbb2610b19
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-023126
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ce20d87052224d56c1719cbbbf7013caa744a1118ae818b1cabea2cf36ac4cb6
Associated tags:
- 20230326-023126
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-023126
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230326-023126].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ce20d87052224d56c1719cbbbf7013caa744a1118ae818b1cabea2cf36ac4cb6].
$ rm -rf /tmp/tmp.HHY9tnAJ14
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3eef4ebc127cd5ed1cac6631ef968d7e81e767935a8d4b809bba08cbade92e0f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3eef4ebc127cd5ed1cac6631ef968d7e81e767935a8d4b809bba08cbade92e0f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230326022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3eef4ebc127cd5ed1cac6631ef968d7e81e767935a8d4b809bba08cbade92e0f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3eef4ebc127cd5ed1cac6631ef968d7e81e767935a8d4b809bba08cbade92e0f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3eef4ebc127cd5ed1cac6631ef968d7e81e767935a8d4b809bba08cbade92e0f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3eef4ebc127cd5ed1cac6631ef968d7e81e767935a8d4b809bba08cbade92e0f].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326022041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ab1f6654b3e71cc0f255b1e43369a2ce5109e7b12e895c551fb21f031a5390f4
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326022041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ab1f6654b3e71cc0f255b1e43369a2ce5109e7b12e895c551fb21f031a5390f4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230326022041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ab1f6654b3e71cc0f255b1e43369a2ce5109e7b12e895c551fb21f031a5390f4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ab1f6654b3e71cc0f255b1e43369a2ce5109e7b12e895c551fb21f031a5390f4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ab1f6654b3e71cc0f255b1e43369a2ce5109e7b12e895c551fb21f031a5390f4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ab1f6654b3e71cc0f255b1e43369a2ce5109e7b12e895c551fb21f031a5390f4].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2569065.
Stopping expansion service pid: 2569066.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 5m 17s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ko7igkfsd7svu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1446
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1446/display/redirect>
Changes:
------------------------------------------
[...truncated 1.00 MB...]
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325202040",
"environmentId": "tTVWBHyvfgbeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.47.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-203104",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-203104"
}
]
},
"name": "go-testxlang_partition-421",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/25 21:17:12 Submitted job: 2023-03-25_14_17_12-14634858388016616754
2023/03/25 21:17:12 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-25_14_17_12-14634858388016616754?project=apache-beam-testing
2023/03/25 21:17:12 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-25_14_17_12-14634858388016616754
2023/03/25 21:17:12 Job state: JOB_STATE_PENDING ...
2023/03/25 21:17:42 Job still running ...
2023/03/25 21:18:12 Job still running ...
2023/03/25 21:18:42 Job still running ...
2023/03/25 21:19:12 Job still running ...
2023/03/25 21:19:42 Job still running ...
2023/03/25 21:20:13 Job still running ...
2023/03/25 21:20:43 Job still running ...
2023/03/25 21:21:13 Job still running ...
2023/03/25 21:21:43 Job still running ...
2023/03/25 21:22:13 Job still running ...
2023/03/25 21:22:43 Job still running ...
2023/03/25 21:23:13 Job still running ...
2023/03/25 21:23:43 Job still running ...
2023/03/25 21:24:13 Job still running ...
2023/03/25 21:24:43 Job still running ...
2023/03/25 21:25:13 Job still running ...
2023/03/25 21:25:43 Job still running ...
2023/03/25 21:26:13 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-25_14_17_12-14634858388016616754 failed
--- FAIL: TestXLang_Partition (581.06s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3307.168s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679776299895443852
--- FAIL: TestBigQueryIO_BasicWriteRead (4.58s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40079 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@OAwRQTlZVz" is_bounded:BOUNDED windowing_strategy_id:"w0@OAwRQTlZVz"}} windowing_strategies:{key:"w0@OAwRQTlZVz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@OAwRQTlZVz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@OAwRQTlZVz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@OAwRQTlZVz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679776299895443852\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"OAwRQTlZVz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40079 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@OAwRQTlZVz" is_bounded:BOUNDED windowing_strategy_id:"w0@OAwRQTlZVz"}} windowing_strategies:{key:"w0@OAwRQTlZVz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@OAwRQTlZVz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@OAwRQTlZVz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@OAwRQTlZVz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679776299895443852\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"OAwRQTlZVz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000152c40})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000152c40})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00058eaa0?, 0xc0001399a0?}, {0x113b23e, 0x39}, {0xc00015a0c0?, 0xa9ea20?, 0x1?}, {0xc0000430f0, 0xf}, 0xc0005c3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc00058ea40?, 0xc0001399a0?}, {0xc00010e900, 0x52}, {0x1?}, {0xc0005c3ea8, 0x2, 0x7f73326663e8?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0000430f0, 0xf}, {0xc00010e900, 0x52}, {0xebcb60, 0xc0005d0400})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001bb380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001bb380, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.615s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.038s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:26f6c962818421dfa1debc2cee2b2d327709753c1558aa506a318121536b4d78
Associated tags:
- 20230325-203104
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-203104
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-203104].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:26f6c962818421dfa1debc2cee2b2d327709753c1558aa506a318121536b4d78].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3e23b4b26a0a1cba96d810f4d4da739bfe8b725520255162349ded24e369765c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3e23b4b26a0a1cba96d810f4d4da739bfe8b725520255162349ded24e369765c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3e23b4b26a0a1cba96d810f4d4da739bfe8b725520255162349ded24e369765c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3e23b4b26a0a1cba96d810f4d4da739bfe8b725520255162349ded24e369765c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325202040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b5d54cfebc938c2e879235ff8a4149beb499cc1dba0be2ec64128b15f79916]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325202040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b5d54cfebc938c2e879235ff8a4149beb499cc1dba0be2ec64128b15f79916])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b5d54cfebc938c2e879235ff8a4149beb499cc1dba0be2ec64128b15f79916
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b5d54cfebc938c2e879235ff8a4149beb499cc1dba0be2ec64128b15f79916].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 29s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/6n4ltrdh3dtku
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1445
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1445/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325142033",
"environmentId": "sBFIxKQbRIbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-143128"
}
]
},
"name": "go-testxlang_partition-917",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/25 15:18:07 Submitted job: 2023-03-25_08_18_07-15161098600335186679
2023/03/25 15:18:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-25_08_18_07-15161098600335186679?project=apache-beam-testing
2023/03/25 15:18:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-25_08_18_07-15161098600335186679
2023/03/25 15:18:07 Job state: JOB_STATE_PENDING ...
2023/03/25 15:18:37 Job still running ...
2023/03/25 15:19:07 Job still running ...
2023/03/25 15:19:37 Job still running ...
2023/03/25 15:20:07 Job still running ...
2023/03/25 15:20:37 Job still running ...
2023/03/25 15:21:07 Job still running ...
2023/03/25 15:21:37 Job still running ...
2023/03/25 15:22:07 Job still running ...
2023/03/25 15:22:38 Job still running ...
2023/03/25 15:23:08 Job still running ...
2023/03/25 15:23:38 Job still running ...
2023/03/25 15:24:08 Job still running ...
2023/03/25 15:24:38 Job still running ...
2023/03/25 15:25:08 Job still running ...
2023/03/25 15:25:38 Job still running ...
2023/03/25 15:26:08 Job still running ...
2023/03/25 15:26:38 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-25_08_18_07-15161098600335186679 failed
--- FAIL: TestXLang_Partition (550.99s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3300.993s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679754730685953393
--- FAIL: TestBigQueryIO_BasicWriteRead (5.70s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46751 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gzagwcXyvV" is_bounded:BOUNDED windowing_strategy_id:"w0@gzagwcXyvV"}} windowing_strategies:{key:"w0@gzagwcXyvV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gzagwcXyvV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gzagwcXyvV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gzagwcXyvV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679754730685953393\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gzagwcXyvV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:46751 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@gzagwcXyvV" is_bounded:BOUNDED windowing_strategy_id:"w0@gzagwcXyvV"}} windowing_strategies:{key:"w0@gzagwcXyvV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@gzagwcXyvV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@gzagwcXyvV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@gzagwcXyvV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679754730685953393\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"gzagwcXyvV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 24 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000018700})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000018700})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a70e0?, 0xc0001819f0?}, {0x113b23e, 0x39}, {0xc0001d20c0?, 0xa9ea20?, 0x1?}, {0xc0001ab6a0, 0xf}, 0xc00016dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a7080?, 0xc0001819f0?}, {0xc000182840, 0x52}, {0x1?}, {0xc00016dea8, 0x2, 0x7f5e6e876d20?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0001ab6a0, 0xf}, {0xc000182840, 0x52}, {0xebcb60, 0xc0001729b0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103a00, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.741s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.041s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.041s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.034s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-143128
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-143128
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b66ebdc5e3e9d9915db6d24dd9fa6843d6131febd01df64e0be3adfc40cca9fe
Deleted: sha256:2b7a3d71cc7bd858c1fdadfd66a7a35a38f9fcd2786308f1ecf27853d4d32e5c
Deleted: sha256:0ac4c1ea322a2900112c79d79c3ae6eb4294de15f44ee834caf6b9d75f514911
Deleted: sha256:ab86dc857912ba80fd31af8418413aea087aa53372e7ae67aea39c83b4de39ee
Deleted: sha256:f40d9a704bfcd00684377d64dc4bb6fa7a17075c4ed05aba2cb816a05dae0046
Deleted: sha256:4a119e956d5b5d17f9e8eee7a1307dce5f823cf7f58213ea713692639b909680
Deleted: sha256:b7f5120b0d355e510c32fd91b18cb2c99ccd6e052582d799a53e54dcf05723bb
Deleted: sha256:e64b0a1dbe6c21f49adba550a2c037b6e1527d0e44d42cdc341c30d3b720efce
Deleted: sha256:4b9a611a26532f7d51b66cbac30981f77156f26c4b24595caa4e34aa9ec237b5
Deleted: sha256:51e4a4a2a269d3b5359723fce54ed2645a028f7027c3021bcca80da4724da2ed
Deleted: sha256:32000e746e82d6de4d006f53693e27a1b060d0f467404760390f504c3a528c55
Deleted: sha256:3656ae55aa698773d8639cd710b067216a3899b990a432886b8fc048ff721970
Deleted: sha256:a28d8956a898389ab81face47893b5ad296e39cae633262de6cef13afe894bde
Deleted: sha256:105e6250a11c556141cb56a746e791d491f247c3b401e74f7be7f281b4b52ebe
Deleted: sha256:d97fcedc839fad57d92c3ddaa74192f7a91fc2be703556bdd03b68eaeeb228f7
Deleted: sha256:a5b0d1abf599c7148a2af6b0359fcd9d049c2ef4d9c1a2f6ed2779d93b1da0cf
Deleted: sha256:782106710815816386b82a6ac12629db476b76a4b0e0a2372e9055ed10c37f3f
Deleted: sha256:d2eaa8520a48230b9af8eebc21429433f3d8628d4efe3fe7089bb58f857f73af
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-143128
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b66ebdc5e3e9d9915db6d24dd9fa6843d6131febd01df64e0be3adfc40cca9fe
Associated tags:
- 20230325-143128
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-143128
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-143128].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b66ebdc5e3e9d9915db6d24dd9fa6843d6131febd01df64e0be3adfc40cca9fe].
$ rm -rf /tmp/tmp.y3aorOkvbX
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c675822646ff34f6b6573495fcc2a4e509a715dc1def419889b23ca9af821cbe
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c675822646ff34f6b6573495fcc2a4e509a715dc1def419889b23ca9af821cbe]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c675822646ff34f6b6573495fcc2a4e509a715dc1def419889b23ca9af821cbe])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c675822646ff34f6b6573495fcc2a4e509a715dc1def419889b23ca9af821cbe
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c675822646ff34f6b6573495fcc2a4e509a715dc1def419889b23ca9af821cbe
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c675822646ff34f6b6573495fcc2a4e509a715dc1def419889b23ca9af821cbe].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325142033
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:527ec9150bf79cfa37a20a0f23193ba02da72695197ff4efcea87358d0610776
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325142033]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:527ec9150bf79cfa37a20a0f23193ba02da72695197ff4efcea87358d0610776]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325142033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:527ec9150bf79cfa37a20a0f23193ba02da72695197ff4efcea87358d0610776])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:527ec9150bf79cfa37a20a0f23193ba02da72695197ff4efcea87358d0610776
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:527ec9150bf79cfa37a20a0f23193ba02da72695197ff4efcea87358d0610776
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:527ec9150bf79cfa37a20a0f23193ba02da72695197ff4efcea87358d0610776].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2148804.
Stopping expansion service pid: 2148805.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 2s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/z77loqb7kpy5q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1444
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1444/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #25868: Fix :examples:java:execute so it can be used
------------------------------------------
[...truncated 693.50 KB...]
#14 211.7 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#14 DONE 212.7s
#15 [beam 11/16] RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1)
#15 2.064 No broken requirements found.
#15 DONE 2.2s
#16 [beam 12/16] RUN pip freeze --all
#16 1.011 absl-py==1.4.0
#16 1.011 apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
#16 1.011 astunparse==1.6.3
#16 1.011 attrs==22.2.0
#16 1.011 beautifulsoup4==4.11.2
#16 1.011 bs4==0.0.1
#16 1.011 cachetools==4.2.4
#16 1.011 certifi==2022.12.7
#16 1.011 cffi==1.15.1
#16 1.011 charset-normalizer==3.1.0
#16 1.011 click==8.1.3
#16 1.011 cloudpickle==2.2.1
#16 1.011 crcmod==1.7
#16 1.011 cryptography==39.0.2
#16 1.011 Cython==0.29.33
#16 1.011 deprecation==2.1.0
#16 1.011 dill==0.3.1.1
#16 1.011 dnspython==2.3.0
#16 1.011 docker==6.0.1
#16 1.011 docopt==0.6.2
#16 1.011 exceptiongroup==1.1.0
#16 1.011 execnet==1.9.0
#16 1.011 fastavro==1.7.3
#16 1.011 fasteners==0.18
#16 1.011 flatbuffers==23.3.3
#16 1.011 freezegun==1.2.2
#16 1.011 future==0.18.3
#16 1.011 gast==0.4.0
#16 1.011 google-api-core==2.11.0
#16 1.011 google-apitools==0.5.31
#16 1.011 google-auth==2.16.2
#16 1.011 google-auth-httplib2==0.1.0
#16 1.011 google-auth-oauthlib==0.4.6
#16 1.011 google-cloud-bigquery==3.6.0
#16 1.011 google-cloud-bigquery-storage==2.19.0
#16 1.011 google-cloud-bigtable==2.17.0
#16 1.011 google-cloud-core==2.3.2
#16 1.011 google-cloud-datastore==2.15.0
#16 1.011 google-cloud-dlp==3.12.0
#16 1.011 google-cloud-language==2.9.0
#16 1.011 google-cloud-pubsub==2.15.0
#16 1.011 google-cloud-pubsublite==1.7.0
#16 1.011 google-cloud-recommendations-ai==0.10.2
#16 1.011 google-cloud-spanner==3.28.0
#16 1.011 google-cloud-videointelligence==2.11.0
#16 1.011 google-cloud-vision==3.4.0
#16 1.011 google-crc32c==1.5.0
#16 1.011 google-pasta==0.2.0
#16 1.011 google-resumable-media==2.4.1
#16 1.011 googleapis-common-protos==1.58.0
#16 1.011 greenlet==2.0.2
#16 1.011 grpc-google-iam-v1==0.12.6
#16 1.011 grpcio==1.51.3
#16 1.011 grpcio-status==1.51.3
#16 1.011 guppy3==3.1.2
#16 1.011 h5py==3.8.0
#16 1.011 hdfs==2.7.0
#16 1.011 httplib2==0.21.0
#16 1.011 hypothesis==6.68.2
#16 1.011 idna==3.4
#16 1.011 importlib-metadata==6.0.0
#16 1.011 iniconfig==2.0.0
#16 1.011 jax==0.4.6
#16 1.011 joblib==1.2.0
#16 1.011 keras==2.12.0rc1
#16 1.011 libclang==15.0.6.1
#16 1.011 Markdown==3.4.1
#16 1.011 MarkupSafe==2.1.2
#16 1.011 mmh3==3.0.0
#16 1.011 mock==5.0.1
#16 1.011 nltk==3.8.1
#16 1.011 nose==1.3.7
#16 1.011 numpy==1.23.5
#16 1.011 oauth2client==4.1.3
#16 1.011 oauthlib==3.2.2
#16 1.011 objsize==0.6.1
#16 1.011 opt-einsum==3.3.0
#16 1.011 orjson==3.8.7
#16 1.011 overrides==6.5.0
#16 1.011 packaging==23.0
#16 1.011 pandas==1.5.3
#16 1.011 parameterized==0.8.1
#16 1.011 pip==23.0.1
#16 1.011 pluggy==1.0.0
#16 1.011 proto-plus==1.22.2
#16 1.011 protobuf==4.22.1
#16 1.011 psycopg2-binary==2.9.5
#16 1.011 py==1.11.0
#16 1.011 pyarrow==9.0.0
#16 1.011 pyasn1==0.4.8
#16 1.011 pyasn1-modules==0.2.8
#16 1.011 pycparser==2.21
#16 1.011 pydot==1.4.2
#16 1.011 PyHamcrest==1.10.1
#16 1.011 pymongo==4.3.3
#16 1.011 PyMySQL==1.0.2
#16 1.011 pyparsing==3.0.9
#16 1.011 pytest==7.2.2
#16 1.011 pytest-forked==1.6.0
#16 1.011 pytest-timeout==2.1.0
#16 1.011 pytest-xdist==2.5.0
#16 1.011 python-dateutil==2.8.2
#16 1.011 python-snappy==0.6.1
#16 1.011 pytz==2022.7.1
#16 1.011 PyYAML==6.0
#16 1.011 regex==2022.10.31
#16 1.011 requests==2.28.2
#16 1.011 requests-mock==1.10.0
#16 1.011 requests-oauthlib==1.3.1
#16 1.011 rsa==4.9
#16 1.011 scikit-learn==1.2.2
#16 1.011 scipy==1.10.1
#16 1.011 setuptools==67.6.0
#16 1.011 six==1.16.0
#16 1.011 sortedcontainers==2.4.0
#16 1.011 soupsieve==2.4
#16 1.011 SQLAlchemy==1.4.46
#16 1.011 sqlparse==0.4.3
#16 1.011 tenacity==5.1.5
#16 1.011 tensorboard==2.12.0
#16 1.011 tensorboard-data-server==0.7.0
#16 1.011 tensorboard-plugin-wit==1.8.1
#16 1.011 tensorflow==2.12.0rc1
#16 1.011 tensorflow-estimator==2.12.0rc0
#16 1.011 tensorflow-io-gcs-filesystem==0.31.0
#16 1.011 termcolor==2.2.0
#16 1.011 testcontainers==3.7.1
#16 1.011 threadpoolctl==3.1.0
#16 1.011 tomli==2.0.1
#16 1.011 tqdm==4.65.0
#16 1.011 typing_extensions==4.5.0
#16 1.011 urllib3==1.26.14
#16 1.011 websocket-client==1.5.1
#16 1.011 Werkzeug==2.2.3
#16 1.011 wheel==0.40.0
#16 1.011 wrapt==1.14.1
#16 1.011 zipp==3.15.0
#16 1.011 zstandard==0.20.0
#16 DONE 1.1s
#17 [beam 13/16] COPY target/LICENSE /opt/apache/beam/
#17 DONE 0.0s
#18 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/
#18 DONE 0.0s
#19 [beam 15/16] COPY target/NOTICE /opt/apache/beam/
#19 DONE 0.0s
#20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/
#20 DONE 0.2s
#21 [third_party_licenses 1/5] COPY target/license_scripts /tmp/license_scripts/
#21 DONE 0.1s
#22 [third_party_licenses 2/5] COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#22 DONE 0.1s
#23 [third_party_licenses 3/5] RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
#23 DONE 0.3s
#24 [third_party_licenses 4/5] COPY target/license_scripts /tmp/license_scripts/
#24 DONE 0.0s
#25 [third_party_licenses 5/5] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#25 1.055 Collecting pip-licenses<4.0.0
#25 1.129 Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
#25 1.137 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0)
#25 1.138 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (5.1.5)
#25 1.176 Collecting PTable
#25 1.196 Downloading PTable-0.9.2.tar.gz (31 kB)
#25 1.213 Preparing metadata (setup.py): started
#25 1.565 Preparing metadata (setup.py): finished with status 'done'
#25 1.580 Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.8/site-packages (from tenacity) (1.16.0)
#25 1.584 Building wheels for collected packages: PTable
#25 1.585 Building wheel for PTable (setup.py): started
#25 2.134 Building wheel for PTable (setup.py): finished with status 'done'
#25 2.135 Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=fae85ca7877aeb565cadeb825c4b1426ac0c848321a6e723c2da53024e154e02
#25 2.135 Stored in directory: /root/.cache/pip/wheels/1b/3a/02/8d8da2bca2223dda2f827949c88b2d82dc85dccbc2bb6265e5
#25 2.141 Successfully built PTable
#25 3.240 Installing collected packages: PTable, pip-licenses
#25 3.328 Successfully installed PTable-0.9.2 pip-licenses-3.5.5
#25 3.329 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#25 16.30 Skip pulling license for bs4
#25 16.30 INFO:root:Successfully pulled licenses for 134 dependencies
#25 DONE 16.4s
#26 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#26 DONE 0.1s
#27 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#27 DONE 0.4s
#28 exporting to image
#28 exporting layers
#28 exporting layers 14.0s done
#28 writing image sha256:2dec1e9703537568ea1ef559beab60412b1d05e66e49140749b64061f2959690 done
#28 naming to docker.io/apache/beam_python3.8_sdk:2.47.0.dev done
#28 DONE 14.0s
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 11m 19s
223 actionable tasks: 147 executed, 64 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/3qsoh4korefr6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1443
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1443/display/redirect>
Changes:
------------------------------------------
[...truncated 1.05 MB...]
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325022540",
"environmentId": "nfSxyHlYypbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-023737"
}
]
},
"name": "go-testxlang_partition-892",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/25 03:23:22 Submitted job: 2023-03-24_20_23_21-14694045234912111206
2023/03/25 03:23:22 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-24_20_23_21-14694045234912111206?project=apache-beam-testing
2023/03/25 03:23:22 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-24_20_23_21-14694045234912111206
2023/03/25 03:23:22 Job state: JOB_STATE_PENDING ...
2023/03/25 03:23:52 Job still running ...
2023/03/25 03:24:22 Job still running ...
2023/03/25 03:24:52 Job still running ...
2023/03/25 03:25:22 Job still running ...
2023/03/25 03:25:52 Job still running ...
2023/03/25 03:26:22 Job still running ...
2023/03/25 03:26:52 Job still running ...
2023/03/25 03:27:22 Job still running ...
2023/03/25 03:27:52 Job still running ...
2023/03/25 03:28:22 Job still running ...
2023/03/25 03:28:52 Job still running ...
2023/03/25 03:29:22 Job still running ...
2023/03/25 03:29:52 Job still running ...
2023/03/25 03:30:23 Job still running ...
2023/03/25 03:30:53 Job still running ...
2023/03/25 03:31:23 Job still running ...
2023/03/25 03:31:53 Job still running ...
2023/03/25 03:32:23 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-24_20_23_21-14694045234912111206 failed
--- FAIL: TestXLang_Partition (582.30s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3277.498s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679711904252226050
--- FAIL: TestBigQueryIO_BasicWriteRead (5.84s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33431 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@CjWtQMDZjC" is_bounded:BOUNDED windowing_strategy_id:"w0@CjWtQMDZjC"}} windowing_strategies:{key:"w0@CjWtQMDZjC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@CjWtQMDZjC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@CjWtQMDZjC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@CjWtQMDZjC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679711904252226050\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"CjWtQMDZjC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33431 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@CjWtQMDZjC" is_bounded:BOUNDED windowing_strategy_id:"w0@CjWtQMDZjC"}} windowing_strategies:{key:"w0@CjWtQMDZjC" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@CjWtQMDZjC" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@CjWtQMDZjC" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@CjWtQMDZjC" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679711904252226050\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"CjWtQMDZjC"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 55 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0002170c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0002170c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a74a0?, 0xc0006c1680?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc000043670, 0xf}, 0xc00017dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a7440?, 0xc0006c1680?}, {0xc00004c9c0, 0x52}, {0x1?}, {0xc00017dea8, 0x2, 0x7f3447b5a248?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000043670, 0xf}, {0xc00004c9c0, 0x52}, {0xebcb60, 0xc0000e6980})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103ba0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103ba0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.870s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.061s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-023737
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-023737
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:93b8b2e68d62777e8c9e1321a1a6f1364658b921e893b86e44ee8c541403de48
Deleted: sha256:27bb8a88183b670b3de3510e1898323948c89f5642920de7daa297dfb444d349
Deleted: sha256:6ded8e7cdc87a75debb5bdfdf041e419af77165d0547f28d4bb0f6ff0a2ae3ed
Deleted: sha256:a7d94aca8385533c4980c1c83095b8451630a1fe8d5e05c40d8dec6f20e21dea
Deleted: sha256:0f4a6dd71f5298d678ee67f94f74dac0f8fa46cc1391f59abcc87e9708d57940
Deleted: sha256:e41a0fbdb0aec4723a8d84eb0ed9d5e1cc93a44047f9d110065ae4d337391f31
Deleted: sha256:eb3e7bb1988270a588b137806a268138928494bca2019d0f2ba25a6fbfce3a93
Deleted: sha256:879567317aaea74c8af4a7c2d4e8b1f6c8898c299e1b3c9252bf83c72096e29b
Deleted: sha256:e46148f9d47deb3c17d9bdf012452afff3e18e1d041d77693ddd0f419fd75813
Deleted: sha256:d7ed30af9ce71bbe3925073027ffdd28ac2963b4ae93eb809cb4734dc443db2c
Deleted: sha256:d004add3633e639bfe921706bf78cc2d0caa744e62a9fdff918efabc469cd493
Deleted: sha256:7b91ecb6e870650b6a1d539e02dab023d22c31c21843ba060266cdd6917f20cb
Deleted: sha256:e9b5284a02acbeff6e3bb9d8de024b8fcbd2ddb18e574da38171178d7277ae6b
Deleted: sha256:03b21ce0f446121906f05feebaf0f24a40ba93f7c9d1c5dc79895351ae6c0346
Deleted: sha256:c769d367a2ba937c243c36c1b64cd66c72ec1e7213d8797a6f76345adb21980d
Deleted: sha256:ac3e34e98448f11ac2008efea3da0f6f331719bdf5522425f99df15c78c945da
Deleted: sha256:f6a5bc68a73821d935d07a57fe1d8b5603b6c2d30e9fd709ab347fa24c576e01
Deleted: sha256:7a077cea8b6d50350ca79d2dfe660c5c24c62f6b46ff4ff23cde69de5a54e4a0
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-023737
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:93b8b2e68d62777e8c9e1321a1a6f1364658b921e893b86e44ee8c541403de48
Associated tags:
- 20230325-023737
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-023737
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230325-023737].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:93b8b2e68d62777e8c9e1321a1a6f1364658b921e893b86e44ee8c541403de48].
$ rm -rf /tmp/tmp.MnRSnuQjq9
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325022540
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11d39cc7b46fe763cfb974a6953786e42bf6236ccf5d57135d1e3e0417f50663
Deleted: sha256:12b5cd373c676713f6a0c47d26487fe66e0520296066438f80df5cd196ca6bec
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325022540]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11d39cc7b46fe763cfb974a6953786e42bf6236ccf5d57135d1e3e0417f50663]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230325022540] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11d39cc7b46fe763cfb974a6953786e42bf6236ccf5d57135d1e3e0417f50663])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11d39cc7b46fe763cfb974a6953786e42bf6236ccf5d57135d1e3e0417f50663
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11d39cc7b46fe763cfb974a6953786e42bf6236ccf5d57135d1e3e0417f50663
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:11d39cc7b46fe763cfb974a6953786e42bf6236ccf5d57135d1e3e0417f50663].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325022540
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:43c3215e609973e5513401e69c613fdd93015f2635cf1056c51d0bd17cef2dc1
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325022540]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:43c3215e609973e5513401e69c613fdd93015f2635cf1056c51d0bd17cef2dc1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230325022540] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:43c3215e609973e5513401e69c613fdd93015f2635cf1056c51d0bd17cef2dc1])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:43c3215e609973e5513401e69c613fdd93015f2635cf1056c51d0bd17cef2dc1
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:43c3215e609973e5513401e69c613fdd93015f2635cf1056c51d0bd17cef2dc1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:43c3215e609973e5513401e69c613fdd93015f2635cf1056c51d0bd17cef2dc1].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3534501.
Stopping expansion service pid: 3534502.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 54s
232 actionable tasks: 178 executed, 44 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/ondtri7erfq7m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1442
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1442/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #25916 Use built-in csv and json readers.
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-203147",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-203147"
}
]
},
"name": "go-testxlang_partition-50",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/24 21:17:51 Submitted job: 2023-03-24_14_17_50-5829823784135220699
2023/03/24 21:17:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-24_14_17_50-5829823784135220699?project=apache-beam-testing
2023/03/24 21:17:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-24_14_17_50-5829823784135220699
2023/03/24 21:17:51 Job state: JOB_STATE_PENDING ...
2023/03/24 21:18:21 Job still running ...
2023/03/24 21:18:51 Job still running ...
2023/03/24 21:19:21 Job still running ...
2023/03/24 21:19:51 Job still running ...
2023/03/24 21:20:21 Job still running ...
2023/03/24 21:20:51 Job still running ...
2023/03/24 21:21:21 Job still running ...
2023/03/24 21:21:51 Job still running ...
2023/03/24 21:22:21 Job still running ...
2023/03/24 21:22:51 Job still running ...
2023/03/24 21:23:21 Job still running ...
2023/03/24 21:23:51 Job still running ...
2023/03/24 21:24:21 Job still running ...
2023/03/24 21:24:51 Job still running ...
2023/03/24 21:25:22 Job still running ...
2023/03/24 21:25:52 Job still running ...
2023/03/24 21:26:22 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-24_14_17_50-5829823784135220699 failed
--- FAIL: TestXLang_Partition (551.82s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3264.566s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679689950943321195
--- FAIL: TestBigQueryIO_BasicWriteRead (4.39s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36541 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@nHIFtltPtB" is_bounded:BOUNDED windowing_strategy_id:"w0@nHIFtltPtB"}} windowing_strategies:{key:"w0@nHIFtltPtB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@nHIFtltPtB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@nHIFtltPtB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@nHIFtltPtB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679689950943321195\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"nHIFtltPtB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36541 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@nHIFtltPtB" is_bounded:BOUNDED windowing_strategy_id:"w0@nHIFtltPtB"}} windowing_strategies:{key:"w0@nHIFtltPtB" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@nHIFtltPtB" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@nHIFtltPtB" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@nHIFtltPtB" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679689950943321195\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"nHIFtltPtB"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 9 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000020780})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000020780})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000168f40?, 0xc000138230?}, {0x113b23e, 0x39}, {0xc00015a0c0?, 0xa9ea20?, 0x1?}, {0xc000131660, 0xf}, 0xc0000d5d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000168ec0?, 0xc000138230?}, {0xc0005c23c0, 0x52}, {0x1?}, {0xc0000d5ea8, 0x2, 0x7fa274f7bb20?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000131660, 0xf}, {0xc0005c23c0, 0x52}, {0xebcb60, 0xc00059e200})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000429520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000429520, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.424s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.039s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-203147
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-203147
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:22401b2fdc029ba92adf92527b5c76746b4f8ff941b8ab9abfbbd594d0714274
Deleted: sha256:c493e2bb9293ed6661f6c77c93dfb8c626815b93ce838f1f20e5bf11444c21c8
Deleted: sha256:4b0979e87ed8c63668a45070a931e9db7cbb09ed2c1b98a3a15e5410d8733eb1
Deleted: sha256:c67a22263093f8847b7bc2c694ecd19db3b238588550bc99814d67870667aae9
Deleted: sha256:60fd7602ced5b4ab4abd5af3ef251c7010cd143b5d866932db17e614e14e6ea5
Deleted: sha256:3d421c2ddd76bea09fefed06ae56af017fda36f657b1b1facedbd8e9732c6846
Deleted: sha256:84a51a719c891545b584749f65916740211be5c881d168454fbd8e1aaf668339
Deleted: sha256:9ad524e78d52a835c8415dad5a4d4f5a61ec95fe6a3d252db9c22e0059ed3711
Deleted: sha256:f9b33845353aa6663b2f9ffaa09302a158f6bf05ce76271c124d04421c455930
Deleted: sha256:a27b1b32cbcdd1615c0ec26397439c8097363f34570425553d6a584f99ecaaf6
Deleted: sha256:3808bedaeeaf3c0df912d8baab3d5bbb0f9af433d1c76d9a061d7af4034de716
Deleted: sha256:7b4541015030e7ad8fdb2071873fa4ce4f7d6e4d6614351beefb4f1ff563314d
Deleted: sha256:53af179b7e83e9f1a49a50c4895830bc727378ddc60260a0c69418c573bc80a0
Deleted: sha256:d9430c0db92e7a575f8346ef1948d74f29557984018f8b556f7c2e692f2a640d
Deleted: sha256:15535eb9732ff1804b7db6b4580930fe92283bfda1e3e9ac3e98a9e4dd7ded36
Deleted: sha256:2e7f9ab315a21b8cb7d6bb07d26375a5c362205b6919c163be6185a3a0b8fe3a
Deleted: sha256:2269f31b61d97119884085020af0558b560bcac1b3d15d9fc60bf96c6ec8dade
Deleted: sha256:e26574b07385a6d0e4fa82fc0e31e0099770d415687ed7184a768e97ae268c5a
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-203147
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:22401b2fdc029ba92adf92527b5c76746b4f8ff941b8ab9abfbbd594d0714274
Associated tags:
- 20230324-203147
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-203147
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-203147].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:22401b2fdc029ba92adf92527b5c76746b4f8ff941b8ab9abfbbd594d0714274].
$ rm -rf /tmp/tmp.zPYE0kfeBh
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324202031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6baf1b965bed23717aef9cea4acfd4defd00516d2e58e6389bf645fe45dd177a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6baf1b965bed23717aef9cea4acfd4defd00516d2e58e6389bf645fe45dd177a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6baf1b965bed23717aef9cea4acfd4defd00516d2e58e6389bf645fe45dd177a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6baf1b965bed23717aef9cea4acfd4defd00516d2e58e6389bf645fe45dd177a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6baf1b965bed23717aef9cea4acfd4defd00516d2e58e6389bf645fe45dd177a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6baf1b965bed23717aef9cea4acfd4defd00516d2e58e6389bf645fe45dd177a].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324202031
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:80fe63b043453337602c5cb6f1568b7b25652b7bb6f32cef586b1bef9eabf50d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324202031]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:80fe63b043453337602c5cb6f1568b7b25652b7bb6f32cef586b1bef9eabf50d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324202031] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:80fe63b043453337602c5cb6f1568b7b25652b7bb6f32cef586b1bef9eabf50d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:80fe63b043453337602c5cb6f1568b7b25652b7bb6f32cef586b1bef9eabf50d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:80fe63b043453337602c5cb6f1568b7b25652b7bb6f32cef586b1bef9eabf50d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:80fe63b043453337602c5cb6f1568b7b25652b7bb6f32cef586b1bef9eabf50d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1049264.
Stopping expansion service pid: 1049265.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 56s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/djadegluu4z4a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1441
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1441/display/redirect>
Changes:
------------------------------------------
[...truncated 674.68 KB...]
keras==2.12.0rc1
libclang==15.0.6.1
Markdown==3.4.1
MarkupSafe==2.1.2
mmh3==3.0.0
mock==5.0.1
nltk==3.8.1
nose==1.3.7
numpy==1.23.5
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.7
overrides==6.5.0
packaging==23.0
pandas==1.5.3
parameterized==0.8.1
pip==23.0.1
pluggy==1.0.0
proto-plus==1.22.2
protobuf==4.22.1
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==4.3.3
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.2
pytest-forked==1.6.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.7.1
PyYAML==6.0
regex==2022.10.31
requests==2.28.2
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.2.2
scipy==1.10.1
setuptools==67.6.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.4
SQLAlchemy==1.4.46
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.12.0
tensorboard-data-server==0.7.0
tensorboard-plugin-wit==1.8.1
tensorflow==2.12.0rc1
tensorflow-estimator==2.12.0rc0
tensorflow-io-gcs-filesystem==0.31.0
termcolor==2.2.0
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.65.0
typing_extensions==4.5.0
urllib3==1.26.14
websocket-client==1.5.1
Werkzeug==2.2.3
wheel==0.40.0
wrapt==1.14.1
zipp==3.15.0
zstandard==0.20.0
Removing intermediate container a3c38385c536
---> 25e430a8b4f3
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> d99d90963e5f
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> a5a8a22297ce
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 8495837466c1
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 7172efa3b553
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 84464cb19600
Removing intermediate container 84464cb19600
---> 2975ba00c2e6
Step 22/32 : FROM beam as third_party_licenses
---> 2975ba00c2e6
Step 23/32 : ARG pull_licenses
---> Running in 524e5c83618a
Removing intermediate container 524e5c83618a
---> 63b3adc1d4fe
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 35c18d5e80f3
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> c1372488d008
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in d697a9a5919a
Removing intermediate container d697a9a5919a
---> 182f34225954
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 26854c9e4c54
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 151fea51fcee
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.8/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=e25c2839748eb6a9d02f558d8cfd71364fb8af3b049b98b897c6272108e6c5fa
Stored in directory: /root/.cache/pip/wheels/1b/3a/02/8d8da2bca2223dda2f827949c88b2d82dc85dccbc2bb6265e5
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mRemoving intermediate container 151fea51fcee
---> 0f0eb60f5aa0
Step 29/32 : FROM beam
---> 2975ba00c2e6
Step 30/32 : ARG pull_licenses
---> Running in 4debcfe8f359
Removing intermediate container 4debcfe8f359
---> ffef422a4170
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 3d566bddf61e
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in ddb1323a3b86
Removing intermediate container ddb1323a3b86
---> ef77282026f9
Successfully built ef77282026f9
Successfully tagged apache/beam_python3.8_sdk:2.47.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
2ea22bae5bde: Preparing
a1638633f193: Preparing
b69142c43a30: Preparing
ad9269dd45b7: Preparing
9b178a4175b2: Preparing
1560ed210fbb: Preparing
05ae278bf0cf: Preparing
77252584f7ab: Preparing
190716cd49bc: Preparing
e2f78e3371c8: Preparing
a0756d250b14: Preparing
de8bd4c841a6: Preparing
61358ed3655e: Preparing
1af4478327c8: Preparing
cc8465ede3c6: Preparing
863eba1bb8a1: Preparing
b4f8c0d84a26: Preparing
5c563cc8b216: Preparing
d4514f8b2aac: Preparing
5ab567b9150b: Preparing
190716cd49bc: Waiting
a90e3914fb92: Preparing
e2f78e3371c8: Waiting
053a1f71007e: Preparing
ec09eb83ea03: Preparing
a0756d250b14: Waiting
de8bd4c841a6: Waiting
61358ed3655e: Waiting
863eba1bb8a1: Waiting
cc8465ede3c6: Waiting
05ae278bf0cf: Waiting
1af4478327c8: Waiting
77252584f7ab: Waiting
5c563cc8b216: Waiting
1560ed210fbb: Waiting
d4514f8b2aac: Waiting
5ab567b9150b: Waiting
ec09eb83ea03: Waiting
a90e3914fb92: Waiting
053a1f71007e: Waiting
2ea22bae5bde: Pushed
9b178a4175b2: Pushed
a1638633f193: Pushed
77252584f7ab: Pushed
190716cd49bc: Pushed
1560ed210fbb: Pushed
a0756d250b14: Pushed
b69142c43a30: Pushed
05ae278bf0cf: Pushed
61358ed3655e: Pushed
cc8465ede3c6: Layer already exists
863eba1bb8a1: Layer already exists
b4f8c0d84a26: Layer already exists
5c563cc8b216: Layer already exists
d4514f8b2aac: Layer already exists
5ab567b9150b: Layer already exists
a90e3914fb92: Layer already exists
053a1f71007e: Layer already exists
ec09eb83ea03: Layer already exists
1af4478327c8: Pushed
ad9269dd45b7: Pushed
e2f78e3371c8: Pushed
de8bd4c841a6: Pushed
20230324142041: digest: sha256:edc7a5f363ad8239d983f04d1e8a0e40aaace30fbbcef6b0c3b46a884c6a3ae7 size: 5156
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 11m 21s
223 actionable tasks: 143 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/nk3ewml5homr4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1440
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1440/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324082041",
"environmentId": "QaTyAyIAvjbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-083148"
}
]
},
"name": "go-testxlang_partition-892",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/24 09:17:19 Submitted job: 2023-03-24_02_17_19-14466495747073985395
2023/03/24 09:17:19 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-24_02_17_19-14466495747073985395?project=apache-beam-testing
2023/03/24 09:17:19 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-24_02_17_19-14466495747073985395
2023/03/24 09:17:19 Job state: JOB_STATE_PENDING ...
2023/03/24 09:17:49 Job still running ...
2023/03/24 09:18:19 Job still running ...
2023/03/24 09:18:49 Job still running ...
2023/03/24 09:19:19 Job still running ...
2023/03/24 09:19:49 Job still running ...
2023/03/24 09:20:19 Job still running ...
2023/03/24 09:20:49 Job still running ...
2023/03/24 09:21:19 Job still running ...
2023/03/24 09:21:49 Job still running ...
2023/03/24 09:22:19 Job still running ...
2023/03/24 09:22:50 Job still running ...
2023/03/24 09:23:20 Job still running ...
2023/03/24 09:23:50 Job still running ...
2023/03/24 09:24:20 Job still running ...
2023/03/24 09:24:50 Job still running ...
2023/03/24 09:25:20 Job still running ...
2023/03/24 09:25:50 Job still running ...
2023/03/24 09:26:20 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-24_02_17_19-14466495747073985395 failed
--- FAIL: TestXLang_Partition (580.31s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3270.614s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679646743176784678
--- FAIL: TestBigQueryIO_BasicWriteRead (4.34s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36089 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EcyojSZKKz" is_bounded:BOUNDED windowing_strategy_id:"w0@EcyojSZKKz"}} windowing_strategies:{key:"w0@EcyojSZKKz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EcyojSZKKz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EcyojSZKKz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EcyojSZKKz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679646743176784678\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EcyojSZKKz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36089 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@EcyojSZKKz" is_bounded:BOUNDED windowing_strategy_id:"w0@EcyojSZKKz"}} windowing_strategies:{key:"w0@EcyojSZKKz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@EcyojSZKKz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@EcyojSZKKz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@EcyojSZKKz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679646743176784678\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"EcyojSZKKz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 25 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0000bdac0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0000bdac0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000400c80?, 0xc0001179f0?}, {0x113b23e, 0x39}, {0xc00015e0c0?, 0xa9ea20?, 0x1?}, {0xc0001376e0, 0xf}, 0xc000645d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000400c20?, 0xc0001179f0?}, {0xc000118840, 0x52}, {0x1?}, {0xc000645ea8, 0x2, 0x7fb6c5623910?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0001376e0, 0xf}, {0xc000118840, 0x52}, {0xebcb60, 0xc0006489f0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0004fd040)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0004fd040, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.376s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-083148
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-083148
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:26f3f50c14ebf088265bf12486870552dc7f4ee430fc6d2ac29b07e6f6d0cafa
Deleted: sha256:25f2e8b4e1e7699e1382d58a708707b6744e73657bc0488b785e66b72f2ae574
Deleted: sha256:47ce3e6fc8a5a221509bff4092ab5d726ee5a20c02f87b5adffb8c45175ed288
Deleted: sha256:13ec64bf8009d586c0ba96e5d1b44071b8185fd04f52f0b49dc718c04ef45107
Deleted: sha256:f0736df687a405e71ad23dc0110feae9068ca03578539944ebbe11f3d25d7e89
Deleted: sha256:75f7ebe26f761df64a7bd5a330a50228d5324c27fd937af7b913fabbc554c536
Deleted: sha256:e655c6a529c4a4cfc53de86e2d23af4acf508ffdff844c13e2afab4e377f2ce5
Deleted: sha256:27df6f0f7bcfc5af39d084bd001086c6ed5822a91d3d4575845b577b28d4dffe
Deleted: sha256:6c5c13a09d914ef346b0f55e1e7c35b52f079e5c9f2ebac116dc7bfc9176971c
Deleted: sha256:5d2b77a87bf915d0c538c183051493e46e0815f96b0b55595f84eb0ba4f195fc
Deleted: sha256:e719cda9d8a7ef6d99874847c454c899a102cf5ac06202e01dc72a2162c7810d
Deleted: sha256:5e625dae08b3fb9428d2d65ff5ac7ec5d697791ebed67d0d8e160dd76bbb178a
Deleted: sha256:73405c33b5bd5e7492a35094abd2148d15b5c07f5e5de4808f6de6920f685075
Deleted: sha256:c09e996d8a8023be2f06d33b3fbae11f6319bcd67d26d8d1fa766f727a972308
Deleted: sha256:37ed91b5eff869e560805ec624248bfd41c1a0be4b2de4c812140cfc7449c62e
Deleted: sha256:728b92d8b85a9b08a2c642802a3b1081898a9dfb0d1bde4299c007050302dbd0
Deleted: sha256:07e5bf8c1138249a87fc4ce85aaeae1a255601f96f1c8eca8065d18a6c158af9
Deleted: sha256:5ed604412ded6092374de195b832c20199d5f47cd2cfef6edd68bda391056476
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-083148
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:26f3f50c14ebf088265bf12486870552dc7f4ee430fc6d2ac29b07e6f6d0cafa
Associated tags:
- 20230324-083148
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-083148
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-083148].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:26f3f50c14ebf088265bf12486870552dc7f4ee430fc6d2ac29b07e6f6d0cafa].
$ rm -rf /tmp/tmp.uxHQWYhoBf
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2137f4e570c16c0c49d60e79b7010f22ea36493fb6ef27f4dd9a6006822fea5c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2137f4e570c16c0c49d60e79b7010f22ea36493fb6ef27f4dd9a6006822fea5c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2137f4e570c16c0c49d60e79b7010f22ea36493fb6ef27f4dd9a6006822fea5c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2137f4e570c16c0c49d60e79b7010f22ea36493fb6ef27f4dd9a6006822fea5c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2137f4e570c16c0c49d60e79b7010f22ea36493fb6ef27f4dd9a6006822fea5c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2137f4e570c16c0c49d60e79b7010f22ea36493fb6ef27f4dd9a6006822fea5c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b38955eac5d69e41cab05a6bb13e1a5cc3dbd31550613e9900501ed2debe770f
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b38955eac5d69e41cab05a6bb13e1a5cc3dbd31550613e9900501ed2debe770f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b38955eac5d69e41cab05a6bb13e1a5cc3dbd31550613e9900501ed2debe770f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b38955eac5d69e41cab05a6bb13e1a5cc3dbd31550613e9900501ed2debe770f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b38955eac5d69e41cab05a6bb13e1a5cc3dbd31550613e9900501ed2debe770f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b38955eac5d69e41cab05a6bb13e1a5cc3dbd31550613e9900501ed2debe770f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 696144.
Stopping expansion service pid: 696145.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 34s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/lar7ekra3eowy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1439
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1439/display/redirect>
Changes:
------------------------------------------
[...truncated 1.08 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324022042",
"environmentId": "DZgcnftaFUbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-023213"
}
]
},
"name": "go-testxlang_partition-556",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/24 03:17:54 Submitted job: 2023-03-23_20_17_53-17072204296596431006
2023/03/24 03:17:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-23_20_17_53-17072204296596431006?project=apache-beam-testing
2023/03/24 03:17:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-23_20_17_53-17072204296596431006
2023/03/24 03:17:54 Job state: JOB_STATE_PENDING ...
2023/03/24 03:18:24 Job still running ...
2023/03/24 03:18:54 Job still running ...
2023/03/24 03:19:24 Job still running ...
2023/03/24 03:19:54 Job still running ...
2023/03/24 03:20:24 Job still running ...
2023/03/24 03:20:54 Job still running ...
2023/03/24 03:21:24 Job still running ...
2023/03/24 03:21:54 Job still running ...
2023/03/24 03:22:24 Job still running ...
2023/03/24 03:22:54 Job still running ...
2023/03/24 03:23:24 Job still running ...
2023/03/24 03:23:54 Job still running ...
2023/03/24 03:24:24 Job still running ...
2023/03/24 03:24:54 Job still running ...
2023/03/24 03:25:24 Job still running ...
2023/03/24 03:25:54 Job still running ...
2023/03/24 03:26:24 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-23_20_17_53-17072204296596431006 failed
--- FAIL: TestXLang_Partition (550.85s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3246.422s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679625171731419144
--- FAIL: TestBigQueryIO_BasicWriteRead (4.87s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36973 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RizhTSQqKV" is_bounded:BOUNDED windowing_strategy_id:"w0@RizhTSQqKV"}} windowing_strategies:{key:"w0@RizhTSQqKV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RizhTSQqKV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RizhTSQqKV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RizhTSQqKV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679625171731419144\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RizhTSQqKV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:36973 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RizhTSQqKV" is_bounded:BOUNDED windowing_strategy_id:"w0@RizhTSQqKV"}} windowing_strategies:{key:"w0@RizhTSQqKV" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RizhTSQqKV" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RizhTSQqKV" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RizhTSQqKV" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679625171731419144\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RizhTSQqKV"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc00066f380})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc00066f380})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a7040?, 0xc0003f6050?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc000124d00, 0xf}, 0xc000199d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a6fa0?, 0xc0003f6050?}, {0xc00004ca20, 0x52}, {0x1?}, {0xc000199ea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000124d00, 0xf}, {0xc00004ca20, 0x52}, {0xebcb60, 0xc00058e138})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc000103a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc000103a00, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.900s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.040s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.036s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.055s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-023213
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-023213
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:961756f20818cd1fd11ba35bee9d27133c712771279cbe36ef954b71cd5ee163
Deleted: sha256:37c5848e1303e51780de26e3fe034941e49fced56d709176d268c7ccd163fd3d
Deleted: sha256:156ece1fa90037b2892eaf6e63b38aef619b0d980888d54851021dcbea159c56
Deleted: sha256:43317240a301d5e868fa8341a897dae2c61ccf9df13d50f7e03543167aca4790
Deleted: sha256:3dc6c0ed2acc82cfca0c03872e182efe695c6206f79b55967732b75e7449e46b
Deleted: sha256:5cb40e7e4c9ab7c2480601385ac6165f1df9ce6b16e2f89da690a8cd2f7ba721
Deleted: sha256:d21c89bd6315439dfb696d054da3b98d3b1f309e0993fc6d000bc69a310fb8c3
Deleted: sha256:cf2eb9066585ce12a92c17bc8240409baf71b14e420f9e309052a3333f75be87
Deleted: sha256:d417b47f37a0c12e08fa204d3ce7f2237132db8d8d72d974e15b80527a48a216
Deleted: sha256:fb4d4eb54b89abb4af760d73202fbc44acaf1faea9d0e556fa88d380a0cd6979
Deleted: sha256:da563b2a489b57899ab4e684d3cfa073f3ce6ea9e8b5fd911ec81ae7e355b8f9
Deleted: sha256:db69e44a150f473bcb132f007fe309db99898bb3ce9f05ee29efb289f0795d69
Deleted: sha256:ae8706f5ba369f6996f80c42ec19a7f64439b3eeaadb607b5b7bcad9f7c4398e
Deleted: sha256:1e70019501b6a68d4ffbd9940975fc72361f460b1b0b6598e25b6eb8c55b6a26
Deleted: sha256:25de7ec0ec18048360cba45fac6ca12f83f1d0d0b8bd118531e9d043c2f19e26
Deleted: sha256:f451d967a59bfa0f2f12455d7fe4111e53427dca909af3e1409c9148c1edc5b7
Deleted: sha256:122df34cbcbd32b678ee5d7e6797b67170bdbd5fe74dd869e4d382d47745fa51
Deleted: sha256:e891478b4e6375efcc26d0e70cab066e915e7192757aa5e303d3fa2e19c85cc3
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-023213
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:961756f20818cd1fd11ba35bee9d27133c712771279cbe36ef954b71cd5ee163
Associated tags:
- 20230324-023213
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-023213
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230324-023213].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:961756f20818cd1fd11ba35bee9d27133c712771279cbe36ef954b71cd5ee163].
$ rm -rf /tmp/tmp.e76ODuQB8u
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324022042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3c5a94749cad1ad245ce2058bf394b37205a8d205997076eca4997444cae66f8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3c5a94749cad1ad245ce2058bf394b37205a8d205997076eca4997444cae66f8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230324022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3c5a94749cad1ad245ce2058bf394b37205a8d205997076eca4997444cae66f8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3c5a94749cad1ad245ce2058bf394b37205a8d205997076eca4997444cae66f8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3c5a94749cad1ad245ce2058bf394b37205a8d205997076eca4997444cae66f8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:3c5a94749cad1ad245ce2058bf394b37205a8d205997076eca4997444cae66f8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324022042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:932cae2458932fa7b7014e6160bdea92c539870efbcc20b5353f2de3fddef9c9
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324022042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:932cae2458932fa7b7014e6160bdea92c539870efbcc20b5353f2de3fddef9c9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230324022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:932cae2458932fa7b7014e6160bdea92c539870efbcc20b5353f2de3fddef9c9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:932cae2458932fa7b7014e6160bdea92c539870efbcc20b5353f2de3fddef9c9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:932cae2458932fa7b7014e6160bdea92c539870efbcc20b5353f2de3fddef9c9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:932cae2458932fa7b7014e6160bdea92c539870efbcc20b5353f2de3fddef9c9].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 564831.
Stopping expansion service pid: 564832.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 38s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/akzik6o4d43q4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1438
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1438/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
2023/03/23 21:27:29 Job still running ...
2023/03/23 21:27:59 Job still running ...
2023/03/23 21:28:29 Job still running ...
2023/03/23 21:28:59 Job still running ...
2023/03/23 21:29:29 Job still running ...
2023/03/23 21:29:59 Job still running ...
2023/03/23 21:30:29 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-23_14_20_58-7753462487578753083 failed
--- FAIL: TestXLang_Partition (615.23s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3341.956s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679603723767152197
--- FAIL: TestBigQueryIO_BasicWriteRead (5.36s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42315 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@cfujnbcFSY" is_bounded:BOUNDED windowing_strategy_id:"w0@cfujnbcFSY"}} windowing_strategies:{key:"w0@cfujnbcFSY" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@cfujnbcFSY" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@cfujnbcFSY" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@cfujnbcFSY" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679603723767152197\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"cfujnbcFSY"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:42315 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@cfujnbcFSY" is_bounded:BOUNDED windowing_strategy_id:"w0@cfujnbcFSY"}} windowing_strategies:{key:"w0@cfujnbcFSY" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@cfujnbcFSY" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@cfujnbcFSY" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@cfujnbcFSY" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679603723767152197\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"cfujnbcFSY"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc00040ccc0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc00040ccc0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004080a0?, 0xc000542000?}, {0x113b23e, 0x39}, {0xc000450000?, 0xa9ea20?, 0x1?}, {0xc0004ceb60, 0xf}, 0xc000145d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc000408020?, 0xc000542000?}, {0xc00004c960, 0x52}, {0x1?}, {0xc000145ea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0004ceb60, 0xf}, {0xc00004c960, 0x52}, {0xebcb60, 0xc00040a198})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0003e1380)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0003e1380, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.389s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-203433
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-203433
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:81911fda7d016d762854fb99d48492d1189552d300f69864dff024312a8530e9
Deleted: sha256:8e8c517eaac32eb0d7239c83b53b64d1059cf2245078514b56051f59676dc447
Deleted: sha256:005f1989af42cfd94ba0e55153f43f90b35c339bd064b51d381fda504d1aca3e
Deleted: sha256:a465062547e6df8f2fe703e061bb0323357c316523b34ed5dbad2010929d4b0e
Deleted: sha256:fa09aa0fe6f33d951d4cfe7cb7eb63bfe671fff66a1682db4001a620a433bac3
Deleted: sha256:4219059a2e3276a34315901350a13de759fc213ff212fd785be613cf887d25a2
Deleted: sha256:ca2e4fea6d7023cd68e96c99f2f0d35f5d13c0985e0e13c2f20654db22614d34
Deleted: sha256:d3a6464ad61bb3db2be6f63bca1357daa39b41a610e5573784320078015268ff
Deleted: sha256:29531367a8d672597779af30e6c398d57a536368e9a00bb93508bbb2f06cc2c5
Deleted: sha256:9abbd86de1709ed91666b8416cca154955520f36d8bae428a04440430c0ad1e2
Deleted: sha256:6f04aa96e8320c10fedc4a6f57ac0363293dd03c9fb943ff2075c688ebc886d1
Deleted: sha256:8840e06b0c957116160df490741cc07c5e7a3b369b896d2c2aeef17832537014
Deleted: sha256:55dd1c5bc78f031861251d425a6a871f59baecdb342674865dc7c81850f73bd4
Deleted: sha256:7115e4a1fe98b3a45d846ab633dade149d35360226710aec42ea1c93238640f6
Deleted: sha256:d0d8d143fa50848e336485b34bd2273d6b94e47466e22312b7f2d5bffc7a409b
Deleted: sha256:391e1671842d9940e08f58ea8b9ac2c4d03b266089ba2f62888c71ebe44c6aef
Deleted: sha256:0da149f31d265abc5d391e85f52531f96dfb06bf08a177ad93b85b6efd9eea79
Deleted: sha256:fb95a96e8d1534a413922c19116b8aee0f555e821926aede43d3766d9bdaf2d6
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-203433
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:81911fda7d016d762854fb99d48492d1189552d300f69864dff024312a8530e9
Associated tags:
- 20230323-203433
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-203433
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-203433].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:81911fda7d016d762854fb99d48492d1189552d300f69864dff024312a8530e9].
$ rm -rf /tmp/tmp.aMNEOrYGkZ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323202058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b69309d8f08a3c9ac302b420779752bdf9bef872ea4ba52b957e5b3026b144f0
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323202058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b69309d8f08a3c9ac302b420779752bdf9bef872ea4ba52b957e5b3026b144f0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323202058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b69309d8f08a3c9ac302b420779752bdf9bef872ea4ba52b957e5b3026b144f0])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b69309d8f08a3c9ac302b420779752bdf9bef872ea4ba52b957e5b3026b144f0
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b69309d8f08a3c9ac302b420779752bdf9bef872ea4ba52b957e5b3026b144f0
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:b69309d8f08a3c9ac302b420779752bdf9bef872ea4ba52b957e5b3026b144f0].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323202058
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ae2cc2ca4fdc0a71852da475f8678b854d942db3c26bfc587de1dab546fa247f
Deleted: sha256:62dc57b50a711b66ff7aa808bc835f706d23fd84956f4419ebbad0f13eb2e790
Deleted: sha256:754cb6186d1fb73bef32e42737a1b8a34ce9cc708f2809d3dc0f1a1dbce9dd6a
Deleted: sha256:e00d09acc4396fa76c0995f5b942216e314a715ba86a753a9ad1cc13bc3b2dd1
Deleted: sha256:8e44e85293695c0ae79f7fb30968e20a4addbca5149f2230056185553d7b9d0b
Deleted: sha256:7817b5bc3e4fca3785b016e673bbf2501b12566915df4d557e1841c7d9c2d57d
Deleted: sha256:8b69809b4365247130c8951cd2e3a230085cdf4461e09bb5d11a8d5334ffc869
Deleted: sha256:8cf715e7b4c769cd40cb0c48616f9cbafb641144d65e3355875f4272b27dd6f7
Deleted: sha256:7f71ea18bde658edf0a3394676cc441aa279ddb85ad27af22a4e6f1490dcc40d
Deleted: sha256:d4941433955945dec918028d2f79dfe2b98b6eb2f9e2c7abedcdfbb96d30e00a
Deleted: sha256:a601e4c913d9707625c418ba7aca4f2cb19902333c5152a37b04e4c06752ec91
Deleted: sha256:1b56497671c6a0c4c2a39e9572eed0d3a95486f527596f7a83d76db53f822b0d
Deleted: sha256:beb2fbd9c1796c3f5c9c15de6222f539944ae1f338f88112dc32d94d7676ac23
Deleted: sha256:23b84ebc8e316cc3c7d1894da9e53ebc5f622f4d588dbb94da7e5e5393634031
Deleted: sha256:fefc00c6ef37ccfb37bbdedaa057bb2e7ebcdb56ffa5cb77526b34ebb7f65b05
Deleted: sha256:71eb9e08e0e1c45e678b27d863c72a97e1f8df0f2eb2a0bbc63497ec038a2f5c
Deleted: sha256:0a96eb2c0c21a58c796df8a8b6c7f2bae36f6b651faa62d6f70c3f1fbce602fa
Deleted: sha256:ff91768deda7736722b83a8618c42bff26a22f30431a134352e04d6de6b54354
Deleted: sha256:b03eed4779a3aae2711e4b6c7c57f12c65e2b5277471024ef315fa1c5a710081
Deleted: sha256:9a93f06d68d011cadecdf9e2a271c6ce9df8bfcedc02516bd78b2370875af4bb
Deleted: sha256:9fb0eb612b35fdff3b4f774264905066648f39be66148dfc3c4e7515213faf40
Deleted: sha256:77c4108135366cb261889e6bfebbed2e90f10a0bba28131f54dacea2e6d914ce
Deleted: sha256:0afff880cbd165ceda99c7744b4638de9f5c2868d3ba496eaa63dae9d532e8e1
Deleted: sha256:3315f3a29d30969fc7c1bccc96ef2fd9cb1bb4cf4e77fd9c5dc3ed5591956396
Deleted: sha256:87040044f7cb1c027c29fef2b0725b713c57cd802c44880ec32cda87a04be2e9
Deleted: sha256:760204bfcb1759d334285faa5bee26a4ed709ebb9454106d078a6729e529f09b
Deleted: sha256:94ce8c908cfe794063bd526af8a6002119def2d7ca6a2bd98ecaf07bcb62f968
Deleted: sha256:d54a73ae9156dba0e3a2fbf0dc02c3811b32dea9f593c7b52525bfb629626534
Deleted: sha256:c79dbaaa22506614a39d4dc511d0b217bb82d4490b7eb41d8d0a8715f265a440
Deleted: sha256:2a8d594a518591fc33d4e6088a3a00208b7fd8674128330670ff0baa892b60c4
Deleted: sha256:01b3a71604fe235d69e28c502caa1762b62e868ab424687195ec1bc93e0741e1
Deleted: sha256:295d12f15aeff8da18ae596c51e176a254db4c6ca20e4eee4b94cee2211fd595
Deleted: sha256:f6678acaca2c6b86270ed6feb5037ccae8d8df7413a2e873a73691e32c0d3c2c
Deleted: sha256:b2cbc762c4a25152f93cafe1d660e36a0ff3ab520cf34905c3bf4982bc5f0d8c
Deleted: sha256:4f9e97a1081b6bd46a9ae538250d6fa0a19de3256906da3e1b40c7aec265f318
Deleted: sha256:30bd4bfcb4150d67ac88a60d097d74e094755e08b2d3643014bd41859236f2ba
Deleted: sha256:2249facef6403464393e8f145e8ca6fbdaae44cca2cef2b83844c3fcbfcb5a9b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323202058]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ae2cc2ca4fdc0a71852da475f8678b854d942db3c26bfc587de1dab546fa247f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323202058] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ae2cc2ca4fdc0a71852da475f8678b854d942db3c26bfc587de1dab546fa247f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ae2cc2ca4fdc0a71852da475f8678b854d942db3c26bfc587de1dab546fa247f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ae2cc2ca4fdc0a71852da475f8678b854d942db3c26bfc587de1dab546fa247f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ae2cc2ca4fdc0a71852da475f8678b854d942db3c26bfc587de1dab546fa247f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 724753.
Stopping expansion service pid: 724754.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 10m 48s
232 actionable tasks: 158 executed, 62 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/k7x6dbjdjoz3q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1437
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1437/display/redirect?page=changes>
Changes:
[noreply] Fix Illegal to use destination for jms producer (#25886)
------------------------------------------
[...truncated 581.17 KB...]
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323142041",
"environmentId": "KqQYfeuCmTbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-143249"
}
]
},
"name": "go-testxlang_partition-677",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/23 15:19:29 Submitted job: 2023-03-23_08_19_28-7316370230569907872
2023/03/23 15:19:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-23_08_19_28-7316370230569907872?project=apache-beam-testing
2023/03/23 15:19:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-23_08_19_28-7316370230569907872
2023/03/23 15:19:29 Job state: JOB_STATE_PENDING ...
2023/03/23 15:19:59 Job still running ...
2023/03/23 15:20:29 Job still running ...
2023/03/23 15:20:59 Job still running ...
2023/03/23 15:21:29 Job still running ...
2023/03/23 15:21:59 Job still running ...
2023/03/23 15:22:29 Job still running ...
2023/03/23 15:22:59 Job still running ...
2023/03/23 15:23:29 Job still running ...
2023/03/23 15:23:59 Job still running ...
2023/03/23 15:24:29 Job still running ...
2023/03/23 15:24:59 Job still running ...
2023/03/23 15:25:29 Job still running ...
2023/03/23 15:25:59 Job still running ...
2023/03/23 15:26:30 Job still running ...
2023/03/23 15:27:00 Job still running ...
2023/03/23 15:27:30 Job still running ...
2023/03/23 15:28:00 Job still running ...
2023/03/23 15:28:30 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-23_08_19_28-7316370230569907872 failed
--- FAIL: TestXLang_Partition (581.69s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3336.174s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679582007226385428
--- FAIL: TestBigQueryIO_BasicWriteRead (4.59s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37793 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MbmUDGEzzi" is_bounded:BOUNDED windowing_strategy_id:"w0@MbmUDGEzzi"}} windowing_strategies:{key:"w0@MbmUDGEzzi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MbmUDGEzzi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MbmUDGEzzi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MbmUDGEzzi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679582007226385428\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MbmUDGEzzi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:37793 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@MbmUDGEzzi" is_bounded:BOUNDED windowing_strategy_id:"w0@MbmUDGEzzi"}} windowing_strategies:{key:"w0@MbmUDGEzzi" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@MbmUDGEzzi" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@MbmUDGEzzi" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@MbmUDGEzzi" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679582007226385428\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"MbmUDGEzzi"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 69 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0005c7100})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0005c7100})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003e00e0?, 0xc0000cc230?}, {0x113b23e, 0x39}, {0xc000150000?, 0xa9ea20?, 0x1?}, {0xc00012a010, 0xf}, 0xc00061fd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003e0040?, 0xc0000cc230?}, {0xc000118360, 0x52}, {0x1?}, {0xc00061fea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00012a010, 0xf}, {0xc000118360, 0x52}, {0xebcb60, 0xc00056e008})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006009c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006009c0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.628s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-143249
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-143249
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:44cbaff17b08b895bcdbc48093695e97e9893141bde6df7b37753560d762112a
Deleted: sha256:0a5fb29f0af033cae52ba4809e1c2aafafc950d4b8c7814f8930b90ecddcf901
Deleted: sha256:ad9901965d30a38a92e750fc792c4eac148bf0987a34c23fc21e0788e1a46f45
Deleted: sha256:5047d37570a50dcf7a0fe50934b37e17d26a0ebb9952657dd69437326c1fc49d
Deleted: sha256:5c4aacfbce069237ba21adc4138357286e0bcc3bb820d69646cd5786d4997508
Deleted: sha256:cab4d2a430c11406dbc5efd9d12d63397565bd17584965295e8d8760af0a5512
Deleted: sha256:7d5d6719e9a41cff2226e49d847cb0f913e536ae6bd198c624570cb998d0d490
Deleted: sha256:9bcaa57ba40fa28f4e4e17d50b38471cd8683ab2faba4ba9e9033ab2343aed60
Deleted: sha256:09c5517d6ae2076a026d20377311d79dd7aae7ad071a52c10193b5b8ddfe4755
Deleted: sha256:ee0d581f3037e61e1a4112cbed553d51cbb93829ad1a0a8cb1ca68e3e0e94e07
Deleted: sha256:b93342a087947157cd35eb10013776c0e03ffd3ae54ae31012fc76a6936f0158
Deleted: sha256:0e695684e505a059c367f29a2b2e7ed92f49d097b385ef7689a1e474a8ec7579
Deleted: sha256:64b478d374933cc75f3b3bc576b01cbf89335ffd126523dd0948271be196228e
Deleted: sha256:7df35f9b253f6c3c921cc9d199a2fb127b1bd7ce652c701cee2af373598b2f90
Deleted: sha256:418c3df1f05fb6eb2b198c1b654d85d5ad10bdb44057f36bb0e5bf69ddcab8af
Deleted: sha256:dc118d6590e3d6b874b55d82af121b3a60208fd689faf2a5f93024120c2830c9
Deleted: sha256:fc708e57c7d0453810076926f8a4da93c16821adb0b2b0f4fed9ff772bb4b0b8
Deleted: sha256:b38d789914b43c91ba5d8305b9b4453fae91a052a86c8f2f0429be66d26ceb87
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-143249
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:44cbaff17b08b895bcdbc48093695e97e9893141bde6df7b37753560d762112a
Associated tags:
- 20230323-143249
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-143249
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-143249].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:44cbaff17b08b895bcdbc48093695e97e9893141bde6df7b37753560d762112a].
$ rm -rf /tmp/tmp.W851DvzTnB
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323142041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3d0b5d638b7ebbec1a45de6939ab165b78b325c6743a9274109caf8c482ed35
Deleted: sha256:b5cc58e624480630bb69bbaeba5b5caca493af01808925b370471bd6198dcb31
Deleted: sha256:d1127aa1860709b9519f78225eab9344e2b83ffa89bef873fc3799a360bacde1
Deleted: sha256:0629c9024ad8a0bc962c9d5ba73da16ca7504c93c1b180fe523d711e37eb67c4
Deleted: sha256:cc092e8d0ea5646a460eb71ed734e3b612c723b1ccd6944de1986c8e9985a295
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3d0b5d638b7ebbec1a45de6939ab165b78b325c6743a9274109caf8c482ed35]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3d0b5d638b7ebbec1a45de6939ab165b78b325c6743a9274109caf8c482ed35])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3d0b5d638b7ebbec1a45de6939ab165b78b325c6743a9274109caf8c482ed35
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3d0b5d638b7ebbec1a45de6939ab165b78b325c6743a9274109caf8c482ed35
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:a3d0b5d638b7ebbec1a45de6939ab165b78b325c6743a9274109caf8c482ed35].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323142041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb726e0833f6e96a7b75b2a65922ae879293cfa51d0de448cff005b6a5728d7b
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323142041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb726e0833f6e96a7b75b2a65922ae879293cfa51d0de448cff005b6a5728d7b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323142041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb726e0833f6e96a7b75b2a65922ae879293cfa51d0de448cff005b6a5728d7b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb726e0833f6e96a7b75b2a65922ae879293cfa51d0de448cff005b6a5728d7b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb726e0833f6e96a7b75b2a65922ae879293cfa51d0de448cff005b6a5728d7b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb726e0833f6e96a7b75b2a65922ae879293cfa51d0de448cff005b6a5728d7b].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4019770.
Stopping expansion service pid: 4019771.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 8m 56s
232 actionable tasks: 154 executed, 66 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/4otaxm32zfvxo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1436
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1436/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323082041",
"environmentId": "VICvvzJWIObeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-083201"
}
]
},
"name": "go-testxlang_partition-400",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/23 09:17:36 Submitted job: 2023-03-23_02_17_36-10372432621191471203
2023/03/23 09:17:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-23_02_17_36-10372432621191471203?project=apache-beam-testing
2023/03/23 09:17:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-23_02_17_36-10372432621191471203
2023/03/23 09:17:36 Job state: JOB_STATE_PENDING ...
2023/03/23 09:18:06 Job still running ...
2023/03/23 09:18:36 Job still running ...
2023/03/23 09:19:06 Job still running ...
2023/03/23 09:19:36 Job still running ...
2023/03/23 09:20:07 Job still running ...
2023/03/23 09:20:37 Job still running ...
2023/03/23 09:21:07 Job still running ...
2023/03/23 09:21:37 Job still running ...
2023/03/23 09:22:07 Job still running ...
2023/03/23 09:22:37 Job still running ...
2023/03/23 09:23:07 Job still running ...
2023/03/23 09:23:37 Job still running ...
2023/03/23 09:24:07 Job still running ...
2023/03/23 09:24:37 Job still running ...
2023/03/23 09:25:07 Job still running ...
2023/03/23 09:25:37 Job still running ...
2023/03/23 09:26:07 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-23_02_17_36-10372432621191471203 failed
--- FAIL: TestXLang_Partition (550.67s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3241.198s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679560359806517743
--- FAIL: TestBigQueryIO_BasicWriteRead (4.44s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35445 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oNoWlPXBdZ" is_bounded:BOUNDED windowing_strategy_id:"w0@oNoWlPXBdZ"}} windowing_strategies:{key:"w0@oNoWlPXBdZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oNoWlPXBdZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oNoWlPXBdZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oNoWlPXBdZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679560359806517743\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oNoWlPXBdZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:35445 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@oNoWlPXBdZ" is_bounded:BOUNDED windowing_strategy_id:"w0@oNoWlPXBdZ"}} windowing_strategies:{key:"w0@oNoWlPXBdZ" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@oNoWlPXBdZ" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@oNoWlPXBdZ" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@oNoWlPXBdZ" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679560359806517743\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"oNoWlPXBdZ"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 29 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0002ab300})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0002ab300})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a6ea0?, 0xc0000bd6d0?}, {0x113b23e, 0x39}, {0xc00015a0c0?, 0xa9ea20?, 0x1?}, {0xc000042db0, 0xf}, 0xc00019dd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a6e40?, 0xc0000bd6d0?}, {0xc00004c540, 0x52}, {0x1?}, {0xc00019dea8, 0x2, 0x7f90acde7a78?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000042db0, 0xf}, {0xc00004c540, 0x52}, {0xebcb60, 0xc0002260c0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000cab60)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000cab60, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.475s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.039s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.033s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-083201
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-083201
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f4601069545ec0913b32bacfe73f185ded11d92f885f7836f017b40377c3cb61
Deleted: sha256:bd6658087be6506b5e17bf6b8535010833c7e7623567511ea2c3690efa4548b2
Deleted: sha256:625e5dd39d4e6fc184d0cd23433fa5aaf650cd55a02d46b91f4881fdddf25eb2
Deleted: sha256:2a5756d2e8c98c36eb4c126363539da43ec201fcc97d2d962db5ccd6e047de8b
Deleted: sha256:4a5e7e0e2df720348fa3fe232cf7b85bf911b3528a97bc3bf0743d50e6d6208b
Deleted: sha256:b1642256dd078e3500c679fccfde57e3cf84ffc2e62e2d40a0ca7bee98cdc4c0
Deleted: sha256:ed82f2e09ccd198e12ac3106299f5b4907add715e106da2fb3be4cc0058d821a
Deleted: sha256:2f308f3d5aa9188d3e6fdc9a1b7980f7364d96c62287ebfd62eb6615f9a3d8a7
Deleted: sha256:1e71da29dbf36369f032425044e5d2d94f883855282efc2952eaf729b98cd1aa
Deleted: sha256:1590cc0b3dfd19d915813fdc4b4cbb69f83e16b56c15c9f31b5b4a4589d40645
Deleted: sha256:61f1eb66c724d3ec2afe4542869b02a0537a5af9444e1e195bdb2555358240a1
Deleted: sha256:51f7a4559fe29f88f12a696a054fe6ad4c981924721f2b9ed7d093ac22980d6b
Deleted: sha256:0fa93f5aa2271cb44ed39e1d015157d2dfbee84aed57a18619e5f05e27da53d0
Deleted: sha256:8879722eb96c1031b3b38f8b6247c822ab57a94c267a23398eb5fa81b4b5ec2f
Deleted: sha256:02dc0c7073ad9b654c55e48b06ac59f330394058f408574906855c7f31881ecf
Deleted: sha256:8f7f67c1a766e06c5aeca3560a893c2e379828dd28f2059366afc99b2633937f
Deleted: sha256:c96c5b964e6c26fd0766327c04374e8b3f09008de72f6b3f94ebfc22c2dc83fc
Deleted: sha256:e44c0319a26889834a3a1829fb4717c785ea8c513bb4231056abc0457f389f59
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-083201
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f4601069545ec0913b32bacfe73f185ded11d92f885f7836f017b40377c3cb61
Associated tags:
- 20230323-083201
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-083201
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-083201].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f4601069545ec0913b32bacfe73f185ded11d92f885f7836f017b40377c3cb61].
$ rm -rf /tmp/tmp.mQ7Gt4iDOJ
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:89cd0a26fbd094c2f1faede4ffbb4a78f4f8e3cd6960b3e8fd9e9cfd99493059
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:89cd0a26fbd094c2f1faede4ffbb4a78f4f8e3cd6960b3e8fd9e9cfd99493059]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:89cd0a26fbd094c2f1faede4ffbb4a78f4f8e3cd6960b3e8fd9e9cfd99493059])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:89cd0a26fbd094c2f1faede4ffbb4a78f4f8e3cd6960b3e8fd9e9cfd99493059
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:89cd0a26fbd094c2f1faede4ffbb4a78f4f8e3cd6960b3e8fd9e9cfd99493059
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:89cd0a26fbd094c2f1faede4ffbb4a78f4f8e3cd6960b3e8fd9e9cfd99493059].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323082041
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4e63de05962708c62a43853741f914205dbb8688e964c4154028fee019d05aa
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323082041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4e63de05962708c62a43853741f914205dbb8688e964c4154028fee019d05aa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323082041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4e63de05962708c62a43853741f914205dbb8688e964c4154028fee019d05aa])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4e63de05962708c62a43853741f914205dbb8688e964c4154028fee019d05aa
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4e63de05962708c62a43853741f914205dbb8688e964c4154028fee019d05aa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4e63de05962708c62a43853741f914205dbb8688e964c4154028fee019d05aa].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3665168.
Stopping expansion service pid: 3665169.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 31s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/yj55mr3jah2di
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1435
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1435/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-023140",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323022027",
"environmentId": "pNRBQaAMsVbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-023140"
}
]
},
"name": "go-testxlang_partition-875",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/23 03:17:42 Submitted job: 2023-03-22_20_17_42-5731930371466602319
2023/03/23 03:17:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-22_20_17_42-5731930371466602319?project=apache-beam-testing
2023/03/23 03:17:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-22_20_17_42-5731930371466602319
2023/03/23 03:17:42 Job state: JOB_STATE_PENDING ...
2023/03/23 03:18:12 Job still running ...
2023/03/23 03:18:42 Job still running ...
2023/03/23 03:19:12 Job still running ...
2023/03/23 03:19:43 Job still running ...
2023/03/23 03:20:13 Job still running ...
2023/03/23 03:20:43 Job still running ...
2023/03/23 03:21:13 Job still running ...
2023/03/23 03:21:43 Job still running ...
2023/03/23 03:22:13 Job still running ...
2023/03/23 03:22:43 Job still running ...
2023/03/23 03:23:13 Job still running ...
2023/03/23 03:23:43 Job still running ...
2023/03/23 03:24:13 Job still running ...
2023/03/23 03:24:43 Job still running ...
2023/03/23 03:25:13 Job still running ...
2023/03/23 03:25:43 Job still running ...
2023/03/23 03:26:13 Job still running ...
2023/03/23 03:26:43 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-22_20_17_42-5731930371466602319 failed
--- FAIL: TestXLang_Partition (582.14s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3300.462s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679538736542961790
--- FAIL: TestBigQueryIO_BasicWriteRead (5.17s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@OVHhiNRffj" is_bounded:BOUNDED windowing_strategy_id:"w0@OVHhiNRffj"}} windowing_strategies:{key:"w0@OVHhiNRffj" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@OVHhiNRffj" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@OVHhiNRffj" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@OVHhiNRffj" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679538736542961790\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"OVHhiNRffj"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:41467 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@OVHhiNRffj" is_bounded:BOUNDED windowing_strategy_id:"w0@OVHhiNRffj"}} windowing_strategies:{key:"w0@OVHhiNRffj" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@OVHhiNRffj" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@OVHhiNRffj" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@OVHhiNRffj" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679538736542961790\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"OVHhiNRffj"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 38 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0001740c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0001740c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0001e1aa0?, 0xc000139720?}, {0x113b23e, 0x39}, {0xc0001d20c0?, 0xa9ea20?, 0x1?}, {0xc000042d80, 0xf}, 0xc000535d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0001e1a40?, 0xc000139720?}, {0xc000180900, 0x52}, {0x1?}, {0xc000535ea8, 0x2, 0x7ff5a409c188?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000042d80, 0xf}, {0xc000180900, 0x52}, {0xebcb60, 0xc000542090})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000c8ea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000c8ea0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 8.205s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.051s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.033s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:68ddd7733dc8c62d0d7d2e76253494276f4346de47cb1bd205156c5c1b9b3b56
Associated tags:
- 20230323-023140
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-023140
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230323-023140].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:68ddd7733dc8c62d0d7d2e76253494276f4346de47cb1bd205156c5c1b9b3b56].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323022027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1d7439def4f2a55a023aec43223b4c0cff35f81b125e9b1889709efe66d2de7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230323022027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1d7439def4f2a55a023aec43223b4c0cff35f81b125e9b1889709efe66d2de7])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1d7439def4f2a55a023aec43223b4c0cff35f81b125e9b1889709efe66d2de7
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f1d7439def4f2a55a023aec43223b4c0cff35f81b125e9b1889709efe66d2de7].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323022027]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:edefb8de4683192d53bd9078219317906fd3444128f4f4644dab9ef738902489]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230323022027] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:edefb8de4683192d53bd9078219317906fd3444128f4f4644dab9ef738902489])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:edefb8de4683192d53bd9078219317906fd3444128f4f4644dab9ef738902489
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:edefb8de4683192d53bd9078219317906fd3444128f4f4644dab9ef738902489].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 11s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/mcfh7hdawq7rm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1434
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1434/display/redirect?page=changes>
Changes:
[noreply] Adds multi-language Python and Java quickstart release validations
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-203201",
"environmentId": "go"
},
{
"capabilities": [
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:string_utf8:v1",
"beam:coder:iterable:v1",
"beam:coder:timer:v1",
"beam:coder:kv:v1",
"beam:coder:length_prefix:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:custom_window:v1",
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322202041",
"environmentId": "eePVtMPVoZbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-203201"
}
]
},
"name": "go-testxlang_partition-955",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/22 21:18:16 Submitted job: 2023-03-22_14_18_15-17074434340333327559
2023/03/22 21:18:16 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-22_14_18_15-17074434340333327559?project=apache-beam-testing
2023/03/22 21:18:16 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-22_14_18_15-17074434340333327559
2023/03/22 21:18:16 Job state: JOB_STATE_PENDING ...
2023/03/22 21:18:46 Job still running ...
2023/03/22 21:19:16 Job still running ...
2023/03/22 21:19:46 Job still running ...
2023/03/22 21:20:16 Job still running ...
2023/03/22 21:20:46 Job still running ...
2023/03/22 21:21:16 Job still running ...
2023/03/22 21:21:46 Job still running ...
2023/03/22 21:22:16 Job still running ...
2023/03/22 21:22:46 Job still running ...
2023/03/22 21:23:16 Job still running ...
2023/03/22 21:23:46 Job still running ...
2023/03/22 21:24:16 Job still running ...
2023/03/22 21:24:46 Job still running ...
2023/03/22 21:25:16 Job still running ...
2023/03/22 21:25:46 Job still running ...
2023/03/22 21:26:16 Job still running ...
2023/03/22 21:26:47 Job still running ...
2023/03/22 21:27:17 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-22_14_18_15-17074434340333327559 failed
--- FAIL: TestXLang_Partition (582.22s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3304.071s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679517166161485370
--- FAIL: TestBigQueryIO_BasicWriteRead (4.41s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45217 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sbEHMgoOYz" is_bounded:BOUNDED windowing_strategy_id:"w0@sbEHMgoOYz"}} windowing_strategies:{key:"w0@sbEHMgoOYz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sbEHMgoOYz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sbEHMgoOYz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sbEHMgoOYz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679517166161485370\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sbEHMgoOYz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45217 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@sbEHMgoOYz" is_bounded:BOUNDED windowing_strategy_id:"w0@sbEHMgoOYz"}} windowing_strategies:{key:"w0@sbEHMgoOYz" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@sbEHMgoOYz" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@sbEHMgoOYz" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@sbEHMgoOYz" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679517166161485370\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"sbEHMgoOYz"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc0000f28c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc0000f28c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000510440?, 0xc000416050?}, {0x113b23e, 0x39}, {0xc00015a0c0?, 0xa9ea20?, 0x1?}, {0xc000042d70, 0xf}, 0xc000157d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0005103e0?, 0xc000416050?}, {0xc00004c5a0, 0x52}, {0x1?}, {0xc000157ea8, 0x2, 0x7fd34019dc58?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000042d70, 0xf}, {0xc00004c5a0, 0x52}, {0xebcb60, 0xc0005120c0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000ccea0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000ccea0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.439s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.033s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cd98efa70a5913da23c4455d61234ba06b35618a3c920aeb8ccf279b8d434a57
Associated tags:
- 20230322-203201
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-203201
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-203201].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:cd98efa70a5913da23c4455d61234ba06b35618a3c920aeb8ccf279b8d434a57].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0095c3a05b1ed7d20a06fac45faf8baf417ef9289f5ee704cb807d953dc68b7c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0095c3a05b1ed7d20a06fac45faf8baf417ef9289f5ee704cb807d953dc68b7c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0095c3a05b1ed7d20a06fac45faf8baf417ef9289f5ee704cb807d953dc68b7c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0095c3a05b1ed7d20a06fac45faf8baf417ef9289f5ee704cb807d953dc68b7c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322202041]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb955dca8952a42ed98fb28b38d57b7db531574d5e8390c150f457ab5fac984f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322202041] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb955dca8952a42ed98fb28b38d57b7db531574d5e8390c150f457ab5fac984f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb955dca8952a42ed98fb28b38d57b7db531574d5e8390c150f457ab5fac984f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb955dca8952a42ed98fb28b38d57b7db531574d5e8390c150f457ab5fac984f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 35s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/27ktkd2w3cxcq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1433
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1433/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322142040",
"environmentId": "zJvmBhmOgKbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-143200"
}
]
},
"name": "go-testxlang_partition-185",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/22 15:17:34 Submitted job: 2023-03-22_08_17_34-17364139839607860895
2023/03/22 15:17:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-22_08_17_34-17364139839607860895?project=apache-beam-testing
2023/03/22 15:17:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-22_08_17_34-17364139839607860895
2023/03/22 15:17:34 Job state: JOB_STATE_PENDING ...
2023/03/22 15:18:04 Job still running ...
2023/03/22 15:18:34 Job still running ...
2023/03/22 15:19:04 Job still running ...
2023/03/22 15:19:34 Job still running ...
2023/03/22 15:20:04 Job still running ...
2023/03/22 15:20:34 Job still running ...
2023/03/22 15:21:04 Job still running ...
2023/03/22 15:21:34 Job still running ...
2023/03/22 15:22:04 Job still running ...
2023/03/22 15:22:34 Job still running ...
2023/03/22 15:23:05 Job still running ...
2023/03/22 15:23:35 Job still running ...
2023/03/22 15:24:05 Job still running ...
2023/03/22 15:24:35 Job still running ...
2023/03/22 15:25:05 Job still running ...
2023/03/22 15:25:35 Job still running ...
2023/03/22 15:26:05 Job still running ...
2023/03/22 15:26:35 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-22_08_17_34-17364139839607860895 failed
--- FAIL: TestXLang_Partition (581.61s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3273.114s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679495555719652445
--- FAIL: TestBigQueryIO_BasicWriteRead (4.57s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33315 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@eOxLQfjjfw" is_bounded:BOUNDED windowing_strategy_id:"w0@eOxLQfjjfw"}} windowing_strategies:{key:"w0@eOxLQfjjfw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@eOxLQfjjfw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@eOxLQfjjfw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@eOxLQfjjfw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679495555719652445\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"eOxLQfjjfw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:33315 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@eOxLQfjjfw" is_bounded:BOUNDED windowing_strategy_id:"w0@eOxLQfjjfw"}} windowing_strategies:{key:"w0@eOxLQfjjfw" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@eOxLQfjjfw" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@eOxLQfjjfw" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@eOxLQfjjfw" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679495555719652445\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"eOxLQfjjfw"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 30 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc00058b8c0})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc00058b8c0})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003f0220?, 0xc000654000?}, {0x113b23e, 0x39}, {0xc00015e0c0?, 0xa9ea20?, 0x1?}, {0xc000582ca0, 0xf}, 0xc000579d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003f01c0?, 0xc000654000?}, {0xc000554300, 0x52}, {0x1?}, {0xc000579ea8, 0x2, 0x7fbe39814fe8?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000582ca0, 0xf}, {0xc000554300, 0x52}, {0xebcb60, 0xc0004800a0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0006429c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0006429c0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.599s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.037s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.035s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-143200
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-143200
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a48807701a694747e138f5d3243dffa81b475d3e5f722b6c11875150a4a30910
Deleted: sha256:5a07113e04ea800b470d5cd20d2a42176d384aaf7ffaee35163f83927d86325e
Deleted: sha256:e67252e1e6c0817545348c41070c982467fc844e279f759656f41caebbc124b6
Deleted: sha256:f8ef11090cd1492e528e9f2422cec896c061a9de54e6b1261a796702c1340c5f
Deleted: sha256:92413a18e49e9f3c21e90ebc3cf420b829ad60232db819c2343212b94e6472d6
Deleted: sha256:db8079d5b51a93ebcc71c51c5fac7cfe6cdd1743d699f4bae3491899a620f5dd
Deleted: sha256:7b56d022f91afdcaafd27d459207164672fe3411a281474a6b3fb4c1fff24ce9
Deleted: sha256:9906d0a56fd7fa1e8ebd636df012e109ccdbe1ebfe03685f9040c851f4d60daf
Deleted: sha256:ade413cb4d30a79c554ee00c2cee44bb113e5408c4e9faec2c9493eb3bf9461f
Deleted: sha256:7524d4c772e7df70392480f039593277fb7802849688c805025dcf3885bb62cd
Deleted: sha256:597956b50b9e6e3527c2011c0c4be3d00fdc48511e859652be1ec60e6b054901
Deleted: sha256:b0eebb005f5b4b875174832470c139f1b4c166bdcddde89262c4ede41d2faa79
Deleted: sha256:a1395485675f7bb62abfe1688b2a246452826733c6566252421c16e676c8177e
Deleted: sha256:3e867ed20faffbb11eb4e14eb864aaa61b34c9248142d842470dd9aa0a5252c0
Deleted: sha256:00c1fe99eb29442918c00171afa8c75a1839c1080f489d5a9e1f247b924d827f
Deleted: sha256:bffe5afda079430e27d14e9974969b3b2c1183810db34dedb4b51f78dae674fc
Deleted: sha256:fa6eae4a91173e5637578083cf058e076041538a4e10863c46056d10ca032b64
Deleted: sha256:7e8dc6f22c93c78dad49bd2129a0db9aa518d71a3562d1f0366e0b6bb8e78883
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-143200
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a48807701a694747e138f5d3243dffa81b475d3e5f722b6c11875150a4a30910
Associated tags:
- 20230322-143200
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-143200
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-143200].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:a48807701a694747e138f5d3243dffa81b475d3e5f722b6c11875150a4a30910].
$ rm -rf /tmp/tmp.aoGbYjJW2X
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:74023482e8ab28f094136185f6e73e9298dab5a553253b4246034422c2c69a28
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:74023482e8ab28f094136185f6e73e9298dab5a553253b4246034422c2c69a28]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:74023482e8ab28f094136185f6e73e9298dab5a553253b4246034422c2c69a28])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:74023482e8ab28f094136185f6e73e9298dab5a553253b4246034422c2c69a28
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:74023482e8ab28f094136185f6e73e9298dab5a553253b4246034422c2c69a28
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:74023482e8ab28f094136185f6e73e9298dab5a553253b4246034422c2c69a28].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322142040
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:49e952a4b51b22be7ec252b1e7ef7c5c8640a795611e72accab17c82d02e26ed
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322142040]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:49e952a4b51b22be7ec252b1e7ef7c5c8640a795611e72accab17c82d02e26ed]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322142040] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:49e952a4b51b22be7ec252b1e7ef7c5c8640a795611e72accab17c82d02e26ed])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:49e952a4b51b22be7ec252b1e7ef7c5c8640a795611e72accab17c82d02e26ed
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:49e952a4b51b22be7ec252b1e7ef7c5c8640a795611e72accab17c82d02e26ed
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:49e952a4b51b22be7ec252b1e7ef7c5c8640a795611e72accab17c82d02e26ed].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2754130.
Stopping expansion service pid: 2754131.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 50s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/l6jzpt6qcrey6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1432
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1432/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-083206",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-083206"
}
]
},
"name": "go-testxlang_partition-144",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/22 09:18:12 Submitted job: 2023-03-22_02_18_12-13410272373313655545
2023/03/22 09:18:12 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-22_02_18_12-13410272373313655545?project=apache-beam-testing
2023/03/22 09:18:12 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-22_02_18_12-13410272373313655545
2023/03/22 09:18:12 Job state: JOB_STATE_PENDING ...
2023/03/22 09:18:42 Job still running ...
2023/03/22 09:19:13 Job still running ...
2023/03/22 09:19:43 Job still running ...
2023/03/22 09:20:13 Job still running ...
2023/03/22 09:20:43 Job still running ...
2023/03/22 09:21:13 Job still running ...
2023/03/22 09:21:43 Job still running ...
2023/03/22 09:22:13 Job still running ...
2023/03/22 09:22:43 Job still running ...
2023/03/22 09:23:14 Job still running ...
2023/03/22 09:23:44 Job still running ...
2023/03/22 09:24:14 Job still running ...
2023/03/22 09:24:44 Job still running ...
2023/03/22 09:25:14 Job still running ...
2023/03/22 09:25:44 Job still running ...
2023/03/22 09:26:14 Job still running ...
2023/03/22 09:26:44 Job still running ...
2023/03/22 09:27:14 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-22_02_18_12-13410272373313655545 failed
--- FAIL: TestXLang_Partition (581.76s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3303.448s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679473964608733324
--- FAIL: TestBigQueryIO_BasicWriteRead (4.88s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34201 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RAJqPZdVvs" is_bounded:BOUNDED windowing_strategy_id:"w0@RAJqPZdVvs"}} windowing_strategies:{key:"w0@RAJqPZdVvs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RAJqPZdVvs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RAJqPZdVvs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RAJqPZdVvs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679473964608733324\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RAJqPZdVvs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:34201 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@RAJqPZdVvs" is_bounded:BOUNDED windowing_strategy_id:"w0@RAJqPZdVvs"}} windowing_strategies:{key:"w0@RAJqPZdVvs" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@RAJqPZdVvs" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@RAJqPZdVvs" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@RAJqPZdVvs" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679473964608733324\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"RAJqPZdVvs"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc00057af00})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc00057af00})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003f0fe0?, 0xc0000b9680?}, {0x113b23e, 0x39}, {0xc0001560c0?, 0xa9ea20?, 0x1?}, {0xc00041afc0, 0xf}, 0xc00053bd20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003f0f80?, 0xc0000b9680?}, {0xc00004c5a0, 0x52}, {0x1?}, {0xc00053bea8, 0x2, 0x7fd7cd7416b0?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc00041afc0, 0xf}, {0xc00004c5a0, 0x52}, {0xebcb60, 0xc0005462d0})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0000c89c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0000c89c0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.918s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.034s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-083206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-083206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:495f523007cfc9686698b6cb04510bc56abcea15e00991cfa992e167118eff10
Deleted: sha256:10e74d2564fa300211f32e4dea357892552b8098e842bab71eb343d4100edc71
Deleted: sha256:64bfbd665f81a764ee9ab6f8118c11b5a279e9f44d7be8d04fd29ffe0492cae8
Deleted: sha256:337bc2a42d2eaf754b5fefe604542c258fdcb8340af17145f839637b8886eec7
Deleted: sha256:f4d16e1859604856b421570e534cc22412d055b832aedf1f637ac380ae34b4ba
Deleted: sha256:c1b195a6f0545b2406be7b9163430f14f616ab7c40151a30cbb98d60a8244a96
Deleted: sha256:739c06eb257a8fbd65b2c96bfe41df7318235fd61bb833da8f77b4883bdef5ed
Deleted: sha256:c677df1d96c22a5057dd700c3b2b2efb2e182e560d3e9532ff94349c95b4b5bf
Deleted: sha256:fabc8fce104d44721429e2139469b7b2c145f7b3041491bb8f6491f5a0ebe2e5
Deleted: sha256:38614fe7299954d78a94b47f740d2371f1d2008adc7e96363c3a7f6a83c2e2d9
Deleted: sha256:2be7b162bf1d25203ddaef47b8ca60119afac4a87587519a57c2a447cbc1131f
Deleted: sha256:c8934c5174e9aae82d0474ac9d0d21c5fa87f8f7c73ea55851d38cc6cf41df6c
Deleted: sha256:34c932870b0353bdaa2c6295431e9e494640eee73895f45b1ad4b21c616c4b5b
Deleted: sha256:06293f574b00bff994bcab8e7fe5469d4ed6a5f799fcd08a56565d4762d610cb
Deleted: sha256:5cbf21309cb05c274cde2cd668513ce814a58bb638ae27997ce89c59c6f3a109
Deleted: sha256:aadbc13fb0cb8e3d439a9d035b6f586df58afe5385cc3337e456900b16681849
Deleted: sha256:1dd28147e3d4412c4c4aae38430f10e1847cfe35f45cedd0ef21842d813f8228
Deleted: sha256:a2054be7c2229f565cd0e34f907fc2291939aed4d0759c5866c090195a4cc21f
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-083206
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:495f523007cfc9686698b6cb04510bc56abcea15e00991cfa992e167118eff10
Associated tags:
- 20230322-083206
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-083206
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-083206].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:495f523007cfc9686698b6cb04510bc56abcea15e00991cfa992e167118eff10].
$ rm -rf /tmp/tmp.Sa5CUuBQcF
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322082042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2b923ea122451ea628109a6045131e2201a838b234ffb006985cdb12472abee8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322082042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2b923ea122451ea628109a6045131e2201a838b234ffb006985cdb12472abee8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322082042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2b923ea122451ea628109a6045131e2201a838b234ffb006985cdb12472abee8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2b923ea122451ea628109a6045131e2201a838b234ffb006985cdb12472abee8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2b923ea122451ea628109a6045131e2201a838b234ffb006985cdb12472abee8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:2b923ea122451ea628109a6045131e2201a838b234ffb006985cdb12472abee8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322082042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e6a348cdd4fb1a1a64820df02580f635dd2d0115d62467fc2f6fb3ff970822f8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322082042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e6a348cdd4fb1a1a64820df02580f635dd2d0115d62467fc2f6fb3ff970822f8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322082042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e6a348cdd4fb1a1a64820df02580f635dd2d0115d62467fc2f6fb3ff970822f8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e6a348cdd4fb1a1a64820df02580f635dd2d0115d62467fc2f6fb3ff970822f8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e6a348cdd4fb1a1a64820df02580f635dd2d0115d62467fc2f6fb3ff970822f8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e6a348cdd4fb1a1a64820df02580f635dd2d0115d62467fc2f6fb3ff970822f8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2494189.
Stopping expansion service pid: 2494190.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 28s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/coyi74ivxrkli
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1431
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1431/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322022037",
"environmentId": "vsiVAXmGywbeam:env:docker:v1"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-023206"
}
]
},
"name": "go-testxlang_partition-136",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/22 03:17:08 Submitted job: 2023-03-21_20_17_08-17922775779799528637
2023/03/22 03:17:08 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-21_20_17_08-17922775779799528637?project=apache-beam-testing
2023/03/22 03:17:08 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-21_20_17_08-17922775779799528637
2023/03/22 03:17:09 Job state: JOB_STATE_PENDING ...
2023/03/22 03:17:39 Job still running ...
2023/03/22 03:18:09 Job still running ...
2023/03/22 03:18:39 Job still running ...
2023/03/22 03:19:09 Job still running ...
2023/03/22 03:19:39 Job still running ...
2023/03/22 03:20:09 Job still running ...
2023/03/22 03:20:39 Job still running ...
2023/03/22 03:21:09 Job still running ...
2023/03/22 03:21:39 Job still running ...
2023/03/22 03:22:09 Job still running ...
2023/03/22 03:22:39 Job still running ...
2023/03/22 03:23:09 Job still running ...
2023/03/22 03:23:39 Job still running ...
2023/03/22 03:24:09 Job still running ...
2023/03/22 03:24:39 Job still running ...
2023/03/22 03:25:09 Job still running ...
2023/03/22 03:25:39 Job still running ...
2023/03/22 03:26:09 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-21_20_17_08-17922775779799528637 failed
--- FAIL: TestXLang_Partition (580.61s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3241.751s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679452361387659886
--- FAIL: TestBigQueryIO_BasicWriteRead (4.70s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40253 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@rjKQFYphaa" is_bounded:BOUNDED windowing_strategy_id:"w0@rjKQFYphaa"}} windowing_strategies:{key:"w0@rjKQFYphaa" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@rjKQFYphaa" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@rjKQFYphaa" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@rjKQFYphaa" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679452361387659886\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"rjKQFYphaa"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:40253 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@rjKQFYphaa" is_bounded:BOUNDED windowing_strategy_id:"w0@rjKQFYphaa"}} windowing_strategies:{key:"w0@rjKQFYphaa" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@rjKQFYphaa" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@rjKQFYphaa" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@rjKQFYphaa" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679452361387659886\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"rjKQFYphaa"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3081)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2122)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 50 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc000547d80})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc000547d80})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a7120?, 0xc0000bc280?}, {0x113b23e, 0x39}, {0xc0000f00c0?, 0xa9ea20?, 0x1?}, {0xc000412f00, 0xf}, 0xc000199d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0000a70a0?, 0xc0000bc280?}, {0xc000652360, 0x52}, {0x1?}, {0xc000199ea8, 0x2, 0xe7b820?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc000412f00, 0xf}, {0xc000652360, 0x52}, {0xebcb60, 0xc000526188})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc00042f6c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc00042f6c0, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.734s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.032s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.032s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-023206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-023206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9868f90968a36886411fbfe6b5c40f0d2e1f5bce7f5afebe7e6cc4811f9f81fd
Deleted: sha256:d879f062b58713fcd1de9492cd9f1251341f93f3f59bb3c4123d4a3dbeb6d79a
Deleted: sha256:58aa57106f1f874647e927bd3b0db4f0bd46dbadbab5c88b5c38d5514ba36043
Deleted: sha256:3ded8cc5612a378b4459f9bb62ebd968ceb6e9531bb8a95c9704880604ebdb62
Deleted: sha256:5edede592fa65551015231bdbd8d0a95209c306d263ea98ae737646476a0ac9f
Deleted: sha256:fbf737ae760e47f4d5d3e8b70b0055984c3a255eb356e828f9346f418cbbd8e2
Deleted: sha256:2b4085a4f1645c7a4bb97b75f03ebb1aca5abd1e0d8222f8acb578acfbc52707
Deleted: sha256:87c960f922b787bb46ddb993ad393597c0957faac5fea6537483cecb53a8981e
Deleted: sha256:cafd019e86957a16859e60be9a6b082c063bf4f27b549279baa97fd4f83f35a4
Deleted: sha256:5900791d6867250db4d63f60b29d981e4d8a1af4de7654e5fcc0a97cfd5b03a7
Deleted: sha256:c249a2cd84af321804154e9d1ec233372e367a7bfdd127a5422e9ce914ab4ced
Deleted: sha256:51f305ea7f69f1c146e32c47bd6d3b50cb6fb64a67b863510544829d83fe5533
Deleted: sha256:7b1c810499831f0fb167d93949120e3c7fefb5ebc46ff9634439732cf550c063
Deleted: sha256:0d9c5f77ef8161409635f59f31137c629b36b9dcdc29ea389608d3c6bd8ec5ae
Deleted: sha256:d0274e5fa9ef7963c26b74c1cfcc12ccd5bce422fcffb607e24b0fe808313da7
Deleted: sha256:826db8b96113e820137bcaa44fa64677893f26400f0d3cfe1353d95976e2f826
Deleted: sha256:07c8f0ad5cce6940de479e0e3727134cd2801d079c12805fa775701230be5fd6
Deleted: sha256:f9d0360dda5c5d8f7ef70d4ca95a0c4992a9a269b0bc636c6b72e2bb4fd30ddf
$ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-023206
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9868f90968a36886411fbfe6b5c40f0d2e1f5bce7f5afebe7e6cc4811f9f81fd
Associated tags:
- 20230322-023206
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-023206
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230322-023206].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9868f90968a36886411fbfe6b5c40f0d2e1f5bce7f5afebe7e6cc4811f9f81fd].
$ rm -rf /tmp/tmp.K4yXTmrq4y
$ exit 1
$ exit 1
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322022037
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7fa3830d3831da2c6a6c89a5fdb0e0b2fd997cb62b72b34a21bb0e08a92d2c7c
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322022037]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7fa3830d3831da2c6a6c89a5fdb0e0b2fd997cb62b72b34a21bb0e08a92d2c7c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230322022037] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7fa3830d3831da2c6a6c89a5fdb0e0b2fd997cb62b72b34a21bb0e08a92d2c7c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7fa3830d3831da2c6a6c89a5fdb0e0b2fd997cb62b72b34a21bb0e08a92d2c7c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7fa3830d3831da2c6a6c89a5fdb0e0b2fd997cb62b72b34a21bb0e08a92d2c7c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7fa3830d3831da2c6a6c89a5fdb0e0b2fd997cb62b72b34a21bb0e08a92d2c7c].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322022037
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eab1fa7475871e39203f63f806969037d84d574a1a1a83fabc3b648dec07ef8
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322022037]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eab1fa7475871e39203f63f806969037d84d574a1a1a83fabc3b648dec07ef8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322022037] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eab1fa7475871e39203f63f806969037d84d574a1a1a83fabc3b648dec07ef8])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eab1fa7475871e39203f63f806969037d84d574a1a1a83fabc3b648dec07ef8
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eab1fa7475871e39203f63f806969037d84d574a1a1a83fabc3b648dec07ef8
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eab1fa7475871e39203f63f806969037d84d574a1a1a83fabc3b648dec07ef8].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2139226.
Stopping expansion service pid: 2139227.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 27s
232 actionable tasks: 167 executed, 53 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/oarq6257oemkq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_GoUsingJava_Dataflow #1430
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/1430/display/redirect?page=changes>
Changes:
[noreply] Raise the Runtime error when DoFn.process uses both yield and return
------------------------------------------
[...truncated 1.01 MB...]
"beam:coder:windowed_value:v1",
"beam:coder:double:v1",
"beam:coder:row:v1",
"beam:coder:param_windowed_value:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:sharded_key:v1",
"beam:coder:nullable:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:protocol:progress_reporting:v1",
"beam:protocol:harness_monitoring_infos:v1",
"beam:protocol:control_request_elements_embedding:v1",
"beam:protocol:state_caching:v1",
"beam:version:sdk_base:apache/beam_java8_sdk:2.47.0.dev",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:transform:to_string:v1",
"beam:protocol:data_sampling:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230321202044",
"environmentId": "sZgUEPyVTObeam:env:docker:v1"
},
{
"capabilities": [
"beam:protocol:progress_reporting:v1",
"beam:protocol:multi_core_bundle_processing:v1",
"beam:transform:sdf_truncate_sized_restrictions:v1",
"beam:protocol:worker_status:v1",
"beam:protocol:monitoring_info_short_ids:v1",
"beam:version:sdk_base:go:apache/beam_go_sdk:2.47.0.dev",
"beam:coder:bytes:v1",
"beam:coder:bool:v1",
"beam:coder:varint:v1",
"beam:coder:double:v1",
"beam:coder:string_utf8:v1",
"beam:coder:length_prefix:v1",
"beam:coder:kv:v1",
"beam:coder:iterable:v1",
"beam:coder:state_backed_iterable:v1",
"beam:coder:windowed_value:v1",
"beam:coder:global_window:v1",
"beam:coder:interval_window:v1",
"beam:coder:row:v1",
"beam:coder:nullable:v1"
],
"containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-203208",
"environmentId": "go"
}
],
"workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-203208"
}
]
},
"name": "go-testxlang_partition-883",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2023/03/21 21:17:52 Submitted job: 2023-03-21_14_17_52-8320782072949220752
2023/03/21 21:17:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2023-03-21_14_17_52-8320782072949220752?project=apache-beam-testing
2023/03/21 21:17:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2023-03-21_14_17_52-8320782072949220752
2023/03/21 21:17:52 Job state: JOB_STATE_PENDING ...
2023/03/21 21:18:22 Job still running ...
2023/03/21 21:18:52 Job still running ...
2023/03/21 21:19:22 Job still running ...
2023/03/21 21:19:52 Job still running ...
2023/03/21 21:20:22 Job still running ...
2023/03/21 21:20:52 Job still running ...
2023/03/21 21:21:22 Job still running ...
2023/03/21 21:21:52 Job still running ...
2023/03/21 21:22:23 Job still running ...
2023/03/21 21:22:53 Job still running ...
2023/03/21 21:23:23 Job still running ...
2023/03/21 21:23:53 Job still running ...
2023/03/21 21:24:23 Job still running ...
2023/03/21 21:24:53 Job still running ...
2023/03/21 21:25:23 Job still running ...
2023/03/21 21:25:53 Job still running ...
2023/03/21 21:26:23 Job still running ...
2023/03/21 21:26:53 Job still running ...
ptest.go:108: Failed to execute job: Job 2023-03-21_14_17_52-8320782072949220752 failed
--- FAIL: TestXLang_Partition (581.67s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 3280.393s
=== RUN TestBigQueryIO_BasicWriteRead
bigquery_test.go:213: Created BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679430766419700821
--- FAIL: TestBigQueryIO_BasicWriteRead (4.77s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45321 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aQuPfgvliM" is_bounded:BOUNDED windowing_strategy_id:"w0@aQuPfgvliM"}} windowing_strategies:{key:"w0@aQuPfgvliM" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aQuPfgvliM" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aQuPfgvliM" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aQuPfgvliM" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679430766419700821\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aQuPfgvliM"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3064)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2121)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_write:v1 against localhost:45321 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@aQuPfgvliM" is_bounded:BOUNDED windowing_strategy_id:"w0@aQuPfgvliM"}} windowing_strategies:{key:"w0@aQuPfgvliM" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@aQuPfgvliM" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@aQuPfgvliM" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07counter\x1a\x02\x10\x04\nZ\n\trand_data\x1aM2K\nI\n\n\n\x04flip\x1a\x02\x10\x08\n\t\n\x03num\x1a\x02\x10\x04\n\n\n\x04word\x1a\x02\x10\x07\x12$293279a3-cab2-4082-b6be-1729f646ba84\x12$40dfa07a-fadd-4e7a-ac47-7534633021ad"}}} coders:{key:"c1@aQuPfgvliM" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12a\x03\x01\x04\x00\\\x04\x01\x06Rapache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1679430766419700821\x05Never"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"aQuPfgvliM"
expansion response error
caused by:
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was STORAGE_WRITE_API
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:3064)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$Write.expand(BigQueryIO.java:2121)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:360)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:232)
at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$2.expand(BigQuerySchemaIOProvider.java:197)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 26 [running]:
testing.tRunner.func1.2({0xf6ef60, 0xc00029ac80})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf6ef60, 0xc00029ac80})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0003faba0?, 0xc0000cb720?}, {0x113b23e, 0x39}, {0xc00015c0c0?, 0xa9ea20?, 0x1?}, {0xc0003f8c10, 0xf}, 0xc0000f3d20, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/bigqueryio.Write({0xc0003fab40?, 0xc0000cb720?}, {0xc00004c4e0, 0x52}, {0x1?}, {0xc0000f3ea8, 0x2, 0x7f6ca47f0c10?})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go>:252 +0x3d7
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.WritePipeline({0xc0003f8c10, 0xf}, {0xc00004c4e0, 0x52}, {0xebcb60, 0xc0003f9f20})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:126 +0x21f
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery.TestBigQueryIO_BasicWriteRead(0xc0001ad520)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/integration/io/xlang/bigquery/bigquery_test.go>:216 +0x1ec
testing.tRunner(0xc0001ad520, 0x116d128)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 7.809s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.040s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:04f41e79944af9e527e443ff70ace02bb07c490b414089e9bc3b52d6ab2349b2
Associated tags:
- 20230321-203208
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-203208
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20230321-203208].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:04f41e79944af9e527e443ff70ace02bb07c490b414089e9bc3b52d6ab2349b2].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230321202044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8d047289b8d744c44b7dfbf9a8bd4e0eb4fe72839d02765e306a5895bc516f5b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230321202044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8d047289b8d744c44b7dfbf9a8bd4e0eb4fe72839d02765e306a5895bc516f5b])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8d047289b8d744c44b7dfbf9a8bd4e0eb4fe72839d02765e306a5895bc516f5b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:8d047289b8d744c44b7dfbf9a8bd4e0eb4fe72839d02765e306a5895bc516f5b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230321202044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef5383de78328855cee5f38384bdfc5797f05c237c917f8fc13d2a9dba1bb2ce]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230321202044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef5383de78328855cee5f38384bdfc5797f05c237c917f8fc13d2a9dba1bb2ce])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef5383de78328855cee5f38384bdfc5797f05c237c917f8fc13d2a9dba1bb2ce
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef5383de78328855cee5f38384bdfc5797f05c237c917f8fc13d2a9dba1bb2ce].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 7m 5s
232 actionable tasks: 152 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ry7nlxslhaxum
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org