You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/05/23 22:28:39 UTC

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #890

See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/890/display/redirect>

Changes:


------------------------------------------
[...truncated 57.46 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011578, {0xc000421340?, 0xc0004bb320?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000000dc0, {0x186feb0, 0xc000195280}, 0xc0000c5630, 0xc0000c5610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000000dc0, {0x186feb0, 0xc000195280})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x186feb0?, 0xc000195280?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x186feb0?, 0xc000195280?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc00037e510, {0x186feb0, 0xc000195280}, {0x22d3b48, 0x1}, {{0x18629d0?, 0xc00040cbc0?}, {0x1898178?, 0xc00040f110?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0000e6000, {0x186fd98?, 0xc0005eacc0?}, 0xc0000020f0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x186fd98?, 0xc0005eacc0?}, 0xc0000128f0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-5 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:37883]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:37883]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:37883], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 13 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1450f20, 0xc0003de2c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871580, {0xc000eef6e0, 0x40a90d?, 0x1?}, {0xc000f03380?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x656e85399849b504?, {0xc000eef6e0?, 0xc00010d6e0?, 0xc00010d6f0?}, {0xc000f03380?, 0xc00010d6d0?, 0xc00010ce50?}, 0xc00010ce60?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000f03380, 0x5a, 0x5a}, 0x246)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128de60?, 0xc000f0b200?}, {0x128de60?, 0xc000f0b218?}, {0x12be6a0?, 0xc000011560?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b1540, {0x186feb0?, 0xc00040ccc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0005b1180, {0x186feb0, 0xc00040ccc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0005b1180, 0xc000f094d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x155?, 0x186feb0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0005b1180, {0x18?, 0xc000062400?}, 0xc000029218, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000f03380?, {0x186feb0?, 0xc00040cc80?}, 0x4214c7?, {0x0?, 0x200?, 0x100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871580, {0xc000eef6e0, 0xc0000c4590?, 0x185edb8?}, {0xc000f03380?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0003776e0, 0xc000420798?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0002b3c08)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15252a0?, 0xc0002b3bd8?}, {0x157bda0?, 0xc000095200?}, {0x12be6a0?, 0xc0002b3c08?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b1680, {0x186feb0?, 0xc00040cc80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0005b1400, {0x186feb0, 0xc00040cc80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0005b1400, 0xc000344ab0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0004232c0, {0x186feb0, 0xc000195280}, 0xc000125880, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011578, {0xc000421340?, 0xc0004bb320?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000000dc0, {0x186feb0, 0xc000195280}, 0xc0000c5630, 0xc0000c5610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000000dc0, {0x186feb0, 0xc000195280})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x186feb0?, 0xc000195280?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x186feb0?, 0xc000195280?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc00037e510, {0x186feb0, 0xc000195280}, {0x22d3b48, 0x1}, {{0x18629d0?, 0xc00040cbc0?}, {0x1898178?, 0xc00040f110?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0000e6000, {0x186fd98?, 0xc0005eacc0?}, 0xc0000020f0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x186fd98?, 0xc0005eacc0?}, 0xc0000128f0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/23 22:28:37  (): java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-5 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:37883]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:37883]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:37883], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 13 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1450f20, 0xc0003de2c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871580, {0xc000eef6e0, 0x40a90d?, 0x1?}, {0xc000f03380?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x656e85399849b504?, {0xc000eef6e0?, 0xc00010d6e0?, 0xc00010d6f0?}, {0xc000f03380?, 0xc00010d6d0?, 0xc00010ce50?}, 0xc00010ce60?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000f03380, 0x5a, 0x5a}, 0x246)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128de60?, 0xc000f0b200?}, {0x128de60?, 0xc000f0b218?}, {0x12be6a0?, 0xc000011560?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b1540, {0x186feb0?, 0xc00040ccc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0005b1180, {0x186feb0, 0xc00040ccc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0005b1180, 0xc000f094d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x155?, 0x186feb0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0005b1180, {0x18?, 0xc000062400?}, 0xc000029218, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000f03380?, {0x186feb0?, 0xc00040cc80?}, 0x4214c7?, {0x0?, 0x200?, 0x100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871580, {0xc000eef6e0, 0xc0000c4590?, 0x185edb8?}, {0xc000f03380?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0003776e0, 0xc000420798?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0002b3c08)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15252a0?, 0xc0002b3bd8?}, {0x157bda0?, 0xc000095200?}, {0x12be6a0?, 0xc0002b3c08?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b1680, {0x186feb0?, 0xc00040cc80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0005b1400, {0x186feb0, 0xc00040cc80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c910, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0005b1400, 0xc000344ab0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0004232c0, {0x186feb0, 0xc000195280}, 0xc000125880, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011578, {0xc000421340?, 0xc0004bb320?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000000dc0, {0x186feb0, 0xc000195280}, 0xc0000c5630, 0xc0000c5610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000000dc0, {0x186feb0, 0xc000195280})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x186feb0?, 0xc000195280?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x186feb0?, 0xc000195280?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc00037e510, {0x186feb0, 0xc000195280}, {0x22d3b48, 0x1}, {{0x18629d0?, 0xc00040cbc0?}, {0x1898178?, 0xc00040f110?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0000e6000, {0x186fd98?, 0xc0005eacc0?}, 0xc0000020f0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x186fd98?, 0xc0005eacc0?}, 0xc0000128f0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/23 22:28:37 Job state: FAILED
2023/05/23 22:28:37 Failed to execute job: job load0tests0go0flink0batch0cogbk0200523215350-root-0523222721-39627b42_7c722de8-5929-4e24-9c1e-ff8f6539c42d failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200523215350-root-0523222721-39627b42_7c722de8-5929-4e24-9c1e-ff8f6539c42d failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x186fd28, 0xc00004c0c0}, {0x16eda78?, 0x237f1f0?}, {0xc0002c5e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/eaekfl24nm5k2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_LoadTests_Go_CoGBK_Flink_batch #913

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/913/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #912

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/912/display/redirect?page=changes>

Changes:

[noreply] Initial implementation of QuotaEvent (#27078)


------------------------------------------
[...truncated 57.56 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000010e70, {0xc000395340?, 0xc0004b8080?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000fac60, {0x1875470, 0xc0004c8200}, 0xc00036f630, 0xc00036f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000fac60, {0x1875470, 0xc0004c8200})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875470?, 0xc0004c8200?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875470?, 0xc0004c8200?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003a2990, {0x1875470, 0xc0004c8200}, {0x22dbc98, 0x1}, {{0x1867f70?, 0xc000396780?}, {0x189d778?, 0xc00039b260?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000190000, {0x1875358?, 0xc0005c0cc0?}, 0xc0005f8640)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875358?, 0xc0005c0cc0?}, 0xc000012180?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 3: process bundle failed for instruction 3 using plan 1-3 : panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-3]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:43179]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:43179]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:43179], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 27 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0003ea1c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b80, {0xc000dd0710, 0x40a90d?, 0x4383bf?}, {0xc000bfd740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc000dd0710?, 0x0?, 0xc000120d00?}, {0xc000bfd740?, 0x9ac1c5a643bdf7f?, 0x822f0a0001000000?}, 0x44316f69f9e2cb82?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000bfd740, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000e93f98?}, {0x1291680?, 0xc000e93fb0?}, {0x12c2180?, 0xc000010e58?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8500, {0x1875470?, 0xc000396880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00057fc20, {0x1875470, 0xc000396880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00057fc20, 0xc000e9acf0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1875470?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00057fc20, {0x18?, 0x2358880?}, 0xc000349c68, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000bfd740?, {0x1875470?, 0xc000396840?}, 0x4214c7?, {0x0?, 0x200?, 0x1c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b80, {0xc000dd0710, 0xc00036e6e8?, 0x1864358?}, {0xc000bfd740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000229d00, 0x7f5d29b995b8?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0004ca0a8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004ca078?}, {0x1580a00?, 0xc0005c6150?}, {0x12c2180?, 0xc0004ca0a8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0xc0003ba270?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8640, {0x1875470?, 0xc000396840}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00057fe60, {0x1875470, 0xc000396840}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00057fe60, 0xc0004d0000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003a4aa0, {0x1875470, 0xc0004c8200}, 0xc0004cc0e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000010e70, {0xc000395340?, 0xc0004b8080?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000fac60, {0x1875470, 0xc0004c8200}, 0xc00036f630, 0xc00036f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000fac60, {0x1875470, 0xc0004c8200})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875470?, 0xc0004c8200?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875470?, 0xc0004c8200?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003a2990, {0x1875470, 0xc0004c8200}, {0x22dbc98, 0x1}, {{0x1867f70?, 0xc000396780?}, {0x189d778?, 0xc00039b260?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000190000, {0x1875358?, 0xc0005c0cc0?}, 0xc0005f8640)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875358?, 0xc0005c0cc0?}, 0xc000012180?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/14 22:29:03  (): java.lang.RuntimeException: Error received from SDK harness for instruction 3: process bundle failed for instruction 3 using plan 1-3 : panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-3]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:43179]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:43179]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:43179], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 27 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0003ea1c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b80, {0xc000dd0710, 0x40a90d?, 0x4383bf?}, {0xc000bfd740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc000dd0710?, 0x0?, 0xc000120d00?}, {0xc000bfd740?, 0x9ac1c5a643bdf7f?, 0x822f0a0001000000?}, 0x44316f69f9e2cb82?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000bfd740, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000e93f98?}, {0x1291680?, 0xc000e93fb0?}, {0x12c2180?, 0xc000010e58?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8500, {0x1875470?, 0xc000396880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00057fc20, {0x1875470, 0xc000396880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00057fc20, 0xc000e9acf0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1875470?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00057fc20, {0x18?, 0x2358880?}, 0xc000349c68, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000bfd740?, {0x1875470?, 0xc000396840?}, 0x4214c7?, {0x0?, 0x200?, 0x1c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b80, {0xc000dd0710, 0xc00036e6e8?, 0x1864358?}, {0xc000bfd740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000229d00, 0x7f5d29b995b8?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0004ca0a8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004ca078?}, {0x1580a00?, 0xc0005c6150?}, {0x12c2180?, 0xc0004ca0a8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0xc0003ba270?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8640, {0x1875470?, 0xc000396840}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00057fe60, {0x1875470, 0xc000396840}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00057fe60, 0xc0004d0000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003a4aa0, {0x1875470, 0xc0004c8200}, 0xc0004cc0e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000010e70, {0xc000395340?, 0xc0004b8080?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000fac60, {0x1875470, 0xc0004c8200}, 0xc00036f630, 0xc00036f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000fac60, {0x1875470, 0xc0004c8200})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875470?, 0xc0004c8200?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875470?, 0xc0004c8200?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003a2990, {0x1875470, 0xc0004c8200}, {0x22dbc98, 0x1}, {{0x1867f70?, 0xc000396780?}, {0x189d778?, 0xc00039b260?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000190000, {0x1875358?, 0xc0005c0cc0?}, 0xc0005f8640)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875358?, 0xc0005c0cc0?}, 0xc000012180?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/14 22:29:03 Job state: FAILED
2023/06/14 22:29:03 Failed to execute job: job load0tests0go0flink0batch0cogbk0200614215337-root-0614222746-2f4d1cfa_a2e0a951-296f-428c-a77f-cc604d77edf9 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200614215337-root-0614222746-2f4d1cfa_a2e0a951-296f-428c-a77f-cc604d77edf9 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18752e8, 0xc00004c0c0}, {0x16f25f1?, 0x23873b0?}, {0xc00072fe60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/afufuekxhsczk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #911

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/911/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #26849: add attribute support to writeAvros and


------------------------------------------
[...truncated 38.61 KB...]
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c11"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c10"
    >
  >
  coders: <
    key: "c12"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c11"
    >
  >
  coders: <
    key: "c13"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\021\n\013num_records\032\002\020\004\n\024\n\016initial_splits\032\002\020\004\n\016\n\010key_size\032\002\020\004\n\020\n\nvalue_size\032\002\020\004\n\022\n\014num_hot_keys\032\002\020\004\n\026\n\020hot_key_fraction\032\002\020\006\022$f691cccd-3963-4ed9-9f25-d9fdfd07b30d"
      >
    >
  >
  coders: <
    key: "c14"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
      >
    >
  >
  coders: <
    key: "c15"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c14"
    >
  >
  coders: <
    key: "c16"
    value: <
      spec: <
        urn: "beam:coder:bool:v1"
      >
    >
  >
  coders: <
    key: "c17"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c15"
      component_coder_ids: "c16"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhpdCklnaXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5lbmNWYXJJbnRaEhAIFiIECBlADyoGCBQSAggIImkKSWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmRlY1ZhckludFoSHAgWIgQIGUADIgYIFBICCAgqBAgZQA8qBAgZQAE="
      >
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c4"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c5"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c5"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c7"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:go:coder:cogbklist:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n6gcr.io/apache-beam-testing/beam-sdk/beam_go_sdk:latest"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:****_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2023/06/13 22:27:07 Using specified **** binary: 'linux_amd64/cogbk'
2023/06/13 22:27:08 Prepared job with id: load-tests-go-flink-batch-cogbk-2-0613215317_edc9a393-c07e-437c-9315-69ab4fb8d250 and staging token: load-tests-go-flink-batch-cogbk-2-0613215317_edc9a393-c07e-437c-9315-69ab4fb8d250
2023/06/13 22:27:14 Staged binary artifact with token: 
2023/06/13 22:27:16 Submitted job: load0tests0go0flink0batch0cogbk0200613215317-root-0613222715-714356e7_62d8e369-01de-405b-a3d7-b96e8768847a
2023/06/13 22:27:17 Job state: STOPPED
2023/06/13 22:27:17 Job state: STARTING
2023/06/13 22:27:17 Job state: RUNNING
2023/06/14 06:15:05 Failed to execute job: failed to get metrics
	caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:8099: connect: connection refused"
	caused by:
rpc error: code = Unavailable desc = error reading from server: EOF
panic: Failed to execute job: failed to get metrics
	caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:8099: connect: connection refused"
	caused by:
rpc error: code = Unavailable desc = error reading from server: EOF

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18752c8, 0xc00004c0c0}, {0x16f25f1?, 0x23873b0?}, {0xc0005c7e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 7h 48m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/bbvyb6t45syb4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #910

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/910/display/redirect?page=changes>

Changes:

[noreply] Bump cloud.google.com/go/bigquery from 1.51.1 to 1.51.2 in /sdks


------------------------------------------
[...truncated 57.82 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00047e018, {0xc000389340?, 0xc00011c880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000453760, {0x1875450, 0xc0005e5fc0}, 0xc000619630, 0xc000619610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000453760, {0x1875450, 0xc0005e5fc0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc0005e5fc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc0005e5fc0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000170480, {0x1875450, 0xc0005e5fc0}, {0x22dbca8, 0x1}, {{0x1867f50?, 0xc00026efc0?}, {0x189d758?, 0xc000193b00?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1875338?, 0xc000538c60?}, 0xc000041270)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc000538c60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-2 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-2]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:35327]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:35327]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:35327], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 26 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00054c2c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0006c1740, 0x40a90d?, 0x4383bf?}, {0xc0006d7080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xffdf3b645a1cac09?, {0xc0006c1740?, 0x0?, 0xc000506d00?}, {0xc0006d7080?, 0x1?, 0x1?}, 0x3c00000000000000?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0006d7080, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc0006db020?}, {0x1291680?, 0xc0006db038?}, {0x12c2180?, 0xc00047e000?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00050e280, {0x1875450?, 0xc00026f0c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000c37a0, {0x1875450, 0xc00026f0c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000c37a0, 0xc0006d93b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000c37a0, {0x18?, 0xc000100000?}, 0xc000172198, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0006d7080?, {0x1875450?, 0xc00026f080?}, 0x4214c7?, {0x0?, 0x200?, 0x100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0006c1740, 0xc0006186e8?, 0x1864338?}, {0xc0006d7080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000265740, 0x7f36dbc8e5b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00066f4e8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc00066f4b8?}, {0x1580a00?, 0xc00053e240?}, {0x12c2180?, 0xc00066f4e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00050e3c0, {0x1875450?, 0xc00026f080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000c39e0, {0x1875450, 0xc00026f080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000c39e0, 0xc00065fcb0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00008f900, {0x1875450, 0xc0005e5fc0}, 0xc000675650, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00047e018, {0xc000389340?, 0xc00011c880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000453760, {0x1875450, 0xc0005e5fc0}, 0xc000619630, 0xc000619610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000453760, {0x1875450, 0xc0005e5fc0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc0005e5fc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc0005e5fc0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000170480, {0x1875450, 0xc0005e5fc0}, {0x22dbca8, 0x1}, {{0x1867f50?, 0xc00026efc0?}, {0x189d758?, 0xc000193b00?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1875338?, 0xc000538c60?}, 0xc000041270)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc000538c60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/12 22:58:28  (): java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-2 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-2]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:35327]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:35327]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:35327], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 26 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00054c2c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0006c1740, 0x40a90d?, 0x4383bf?}, {0xc0006d7080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xffdf3b645a1cac09?, {0xc0006c1740?, 0x0?, 0xc000506d00?}, {0xc0006d7080?, 0x1?, 0x1?}, 0x3c00000000000000?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0006d7080, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc0006db020?}, {0x1291680?, 0xc0006db038?}, {0x12c2180?, 0xc00047e000?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00050e280, {0x1875450?, 0xc00026f0c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000c37a0, {0x1875450, 0xc00026f0c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000c37a0, 0xc0006d93b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000c37a0, {0x18?, 0xc000100000?}, 0xc000172198, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0006d7080?, {0x1875450?, 0xc00026f080?}, 0x4214c7?, {0x0?, 0x200?, 0x100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0006c1740, 0xc0006186e8?, 0x1864338?}, {0xc0006d7080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000265740, 0x7f36dbc8e5b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00066f4e8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc00066f4b8?}, {0x1580a00?, 0xc00053e240?}, {0x12c2180?, 0xc00066f4e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00050e3c0, {0x1875450?, 0xc00026f080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000c39e0, {0x1875450, 0xc00026f080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000c39e0, 0xc00065fcb0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00008f900, {0x1875450, 0xc0005e5fc0}, 0xc000675650, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00047e018, {0xc000389340?, 0xc00011c880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000453760, {0x1875450, 0xc0005e5fc0}, 0xc000619630, 0xc000619610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000453760, {0x1875450, 0xc0005e5fc0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc0005e5fc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc0005e5fc0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000170480, {0x1875450, 0xc0005e5fc0}, {0x22dbca8, 0x1}, {{0x1867f50?, 0xc00026efc0?}, {0x189d758?, 0xc000193b00?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1875338?, 0xc000538c60?}, 0xc000041270)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc000538c60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/12 22:58:28 Job state: FAILED
2023/06/12 22:58:28 Failed to execute job: job load0tests0go0flink0batch0cogbk0200612224101-root-0612225710-14ff0a02_79129617-ed7d-4f8c-aa32-6d799243cbd1 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200612224101-root-0612225710-14ff0a02_79129617-ed7d-4f8c-aa32-6d799243cbd1 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18752c8, 0xc00004c0c0}, {0x16f25f1?, 0x23873b0?}, {0xc0003bfe60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 3s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/y7jxhustreziy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #909

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/909/display/redirect?page=changes>

Changes:

[noreply] Add required commands to allowlist_externals in tox.ini (#27089)


------------------------------------------
[...truncated 57.40 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004c8b88, {0xc000357340?, 0xc0000465a0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003162c0, {0x1875450, 0xc0004922c0}, 0xc0005fd630, 0xc0005fd610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003162c0, {0x1875450, 0xc0004922c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc0004922c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc0004922c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002ef680, {0x1875450, 0xc0004922c0}, {0x22dbc98, 0x1}, {{0x1867f50?, 0xc0004c6700?}, {0x189d758?, 0xc00035e060?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002a8000, {0x1875338?, 0xc00021acc0?}, 0xc000100f50)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc00021acc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 3: process bundle failed for instruction 3 using plan 1-5 : panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:46519]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:46519]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:46519], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 16 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00063e5c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0007563f0, 0x40a90d?, 0x4383bf?}, {0xc00074ed80?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x23873b0?, {0xc0007563f0?, 0xa?, 0xa?}, {0xc00074ed80?, 0x5a?, 0x5a?}, 0xc0004c8b70?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00074ed80, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc00075c288?}, {0x1291680?, 0xc00075c2a0?}, {0x12c2180?, 0xc0004c8b70?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8b40, {0x1875450?, 0xc0004c6880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00015d680, {0x1875450, 0xc0004c6880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00015d680, 0xc000753170)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00015d680, {0x18?, 0xc000062400?}, 0xc00046be78, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00074ed80?, {0x1875450?, 0xc0004c6800?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0007563f0, 0xc0005fc6e8?, 0x1864338?}, {0xc00074ed80?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0002286a0, 0x7f344bb40108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0004c83f0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004c83c0?}, {0x1580a00?, 0xc00027c330?}, {0x12c2180?, 0xc0004c83f0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8c80, {0x1875450?, 0xc0004c6800}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00015d8c0, {0x1875450, 0xc0004c6800}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00015d8c0, 0xc00065a000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00035a5a0, {0x1875450, 0xc0004922c0}, 0xc00003f9d0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004c8b88, {0xc000357340?, 0xc0000465a0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003162c0, {0x1875450, 0xc0004922c0}, 0xc0005fd630, 0xc0005fd610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003162c0, {0x1875450, 0xc0004922c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc0004922c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc0004922c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002ef680, {0x1875450, 0xc0004922c0}, {0x22dbc98, 0x1}, {{0x1867f50?, 0xc0004c6700?}, {0x189d758?, 0xc00035e060?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002a8000, {0x1875338?, 0xc00021acc0?}, 0xc000100f50)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc00021acc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/11 22:28:38  (): java.lang.RuntimeException: Error received from SDK harness for instruction 3: process bundle failed for instruction 3 using plan 1-5 : panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:46519]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:46519]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:46519], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{3 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 16 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00063e5c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0007563f0, 0x40a90d?, 0x4383bf?}, {0xc00074ed80?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x23873b0?, {0xc0007563f0?, 0xa?, 0xa?}, {0xc00074ed80?, 0x5a?, 0x5a?}, 0xc0004c8b70?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00074ed80, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc00075c288?}, {0x1291680?, 0xc00075c2a0?}, {0x12c2180?, 0xc0004c8b70?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8b40, {0x1875450?, 0xc0004c6880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00015d680, {0x1875450, 0xc0004c6880}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00015d680, 0xc000753170)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00015d680, {0x18?, 0xc000062400?}, 0xc00046be78, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00074ed80?, {0x1875450?, 0xc0004c6800?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc0007563f0, 0xc0005fc6e8?, 0x1864338?}, {0xc00074ed80?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0002286a0, 0x7f344bb40108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0004c83f0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004c83c0?}, {0x1580a00?, 0xc00027c330?}, {0x12c2180?, 0xc0004c83f0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e8c80, {0x1875450?, 0xc0004c6800}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00015d8c0, {0x1875450, 0xc0004c6800}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00015d8c0, 0xc00065a000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00035a5a0, {0x1875450, 0xc0004922c0}, 0xc00003f9d0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004c8b88, {0xc000357340?, 0xc0000465a0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003162c0, {0x1875450, 0xc0004922c0}, 0xc0005fd630, 0xc0005fd610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003162c0, {0x1875450, 0xc0004922c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc0004922c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc0004922c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002ef680, {0x1875450, 0xc0004922c0}, {0x22dbc98, 0x1}, {{0x1867f50?, 0xc0004c6700?}, {0x189d758?, 0xc00035e060?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002a8000, {0x1875338?, 0xc00021acc0?}, 0xc000100f50)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc00021acc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/11 22:28:39 Job state: FAILED
2023/06/11 22:28:39 Failed to execute job: job load0tests0go0flink0batch0cogbk0200611215311-root-0611222714-50a763c4_c3027ea3-6002-4dfe-b3e6-0543af77a1be failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200611215311-root-0611222714-50a763c4_c3027ea3-6002-4dfe-b3e6-0543af77a1be failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18752c8, 0xc00004c0c0}, {0x16f25f1?, 0x23873b0?}, {0xc0006e3e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/ilrs3vnb2knv2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #908

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/908/display/redirect>

Changes:


------------------------------------------
[...truncated 57.38 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000316c00, {0xc00027b340?, 0xc000445880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003fe160, {0x1875450, 0xc00044e9c0}, 0xc00040d630, 0xc00040d610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003fe160, {0x1875450, 0xc00044e9c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc00044e9c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc00044e9c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000330d80, {0x1875450, 0xc00044e9c0}, {0x22dbcc8, 0x1}, {{0x1867f50?, 0xc000318c80?}, {0x189d758?, 0xc0005bb1d0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00003a000, {0x1875338?, 0xc0005bb710?}, 0xc000093db0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc0005bb710?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 9: process bundle failed for instruction 9 using plan 1-7 : panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-7]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:44291]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:44291]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:44291], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 36 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00032edc0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000b282c0, 0x40a90d?, 0x1?}, {0xc000b22a20?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x23873b0?, {0xc000b282c0?, 0xa?, 0xa?}, {0xc000b22a20?, 0x5a?, 0x5a?}, 0xc000316bd0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000b22a20, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000b2a7b0?}, {0x1291680?, 0xc000b2a7c8?}, {0x12c2180?, 0xc000316bd0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000ee640, {0x1875450?, 0xc000318e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00029cfc0, {0x1875450, 0xc000318e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00029cfc0, 0xc000b2c480)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x9c866d?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00029cfc0, {0x18?, 0xc000062800?}, 0xc00027f6e8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000b22a20?, {0x1875450?, 0xc000318dc0?}, 0x0?, {0x0?, 0x7ff63241ab58?, 0x2387e28?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000b282c0, 0xc00040c6e8?, 0x1864338?}, {0xc000b22a20?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000234230, 0x7ff659b23108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000010c60)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000010c30?}, {0x1580a00?, 0xc000020f60?}, {0x12c2180?, 0xc000010c60?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x7ff659b23108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000ee780, {0x1875450?, 0xc000318dc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00029d200, {0x1875450, 0xc000318dc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00029d200, 0xc000253d40)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00037a8c0, {0x1875450, 0xc00044e9c0}, 0xc00058fd50, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000316c00, {0xc00027b340?, 0xc000445880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003fe160, {0x1875450, 0xc00044e9c0}, 0xc00040d630, 0xc00040d610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003fe160, {0x1875450, 0xc00044e9c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc00044e9c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc00044e9c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000330d80, {0x1875450, 0xc00044e9c0}, {0x22dbcc8, 0x1}, {{0x1867f50?, 0xc000318c80?}, {0x189d758?, 0xc0005bb1d0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00003a000, {0x1875338?, 0xc0005bb710?}, 0xc000093db0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc0005bb710?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/10 22:28:51  (): java.lang.RuntimeException: Error received from SDK harness for instruction 9: process bundle failed for instruction 9 using plan 1-7 : panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-7]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:44291]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:44291]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:44291], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 36 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00032edc0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000b282c0, 0x40a90d?, 0x1?}, {0xc000b22a20?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x23873b0?, {0xc000b282c0?, 0xa?, 0xa?}, {0xc000b22a20?, 0x5a?, 0x5a?}, 0xc000316bd0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000b22a20, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000b2a7b0?}, {0x1291680?, 0xc000b2a7c8?}, {0x12c2180?, 0xc000316bd0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000ee640, {0x1875450?, 0xc000318e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00029cfc0, {0x1875450, 0xc000318e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00029cfc0, 0xc000b2c480)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x9c866d?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00029cfc0, {0x18?, 0xc000062800?}, 0xc00027f6e8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000b22a20?, {0x1875450?, 0xc000318dc0?}, 0x0?, {0x0?, 0x7ff63241ab58?, 0x2387e28?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000b282c0, 0xc00040c6e8?, 0x1864338?}, {0xc000b22a20?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000234230, 0x7ff659b23108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000010c60)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000010c30?}, {0x1580a00?, 0xc000020f60?}, {0x12c2180?, 0xc000010c60?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x7ff659b23108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000ee780, {0x1875450?, 0xc000318dc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00029d200, {0x1875450, 0xc000318dc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00029d200, 0xc000253d40)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00037a8c0, {0x1875450, 0xc00044e9c0}, 0xc00058fd50, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000316c00, {0xc00027b340?, 0xc000445880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003fe160, {0x1875450, 0xc00044e9c0}, 0xc00040d630, 0xc00040d610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003fe160, {0x1875450, 0xc00044e9c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc00044e9c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc00044e9c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000330d80, {0x1875450, 0xc00044e9c0}, {0x22dbcc8, 0x1}, {{0x1867f50?, 0xc000318c80?}, {0x189d758?, 0xc0005bb1d0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00003a000, {0x1875338?, 0xc0005bb710?}, 0xc000093db0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc0005bb710?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/10 22:28:51 Job state: FAILED
2023/06/10 22:28:51 Failed to execute job: job load0tests0go0flink0batch0cogbk0200610215338-root-0610222717-69f5301d_69c7eb33-dc05-4f9e-aa58-166023a42244 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200610215338-root-0610222717-69f5301d_69c7eb33-dc05-4f9e-aa58-166023a42244 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18752c8, 0xc00004c0c0}, {0x16f25f1?, 0x23873b0?}, {0xc0005f3e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 4s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/hkquomislrrj2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #907

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/907/display/redirect>

Changes:


------------------------------------------
[...truncated 57.43 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004844e0, {0xc0004e9340?, 0xc0004b8e60?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0004aa000, {0x1875450, 0xc000099940}, 0xc00068b630, 0xc00068b610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0004aa000, {0x1875450, 0xc000099940})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc000099940?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc000099940?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0000cf170, {0x1875450, 0xc000099940}, {0x22dbca0, 0x1}, {{0x1867f50?, 0xc000483100?}, {0x189d758?, 0xc0004ce840?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00015a000, {0x1875338?, 0xc0005eecc0?}, 0xc0001008c0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc0005eecc0?}, 0xc0002f6fe0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-5 : panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:36545]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:36545]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:36545], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 33 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0004822c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000c30b40, 0x40a90d?, 0x4383bf?}, {0xc000c46060?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc000c30b40?, 0x0?, 0xc0004c31e0?}, {0xc000c46060?, 0x9ac1c5a643bdf7f?, 0xfd520a0001000000?}, 0x3f164f65822107fc?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000c46060, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000c42120?}, {0x1291680?, 0xc000c42138?}, {0x12c2180?, 0xc0004844c8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b4c80, {0x1875450?, 0xc000483200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002ff680, {0x1875450, 0xc000483200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002ff680, 0xc000c3c990)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0002ff680, {0x18?, 0xc000544800?}, 0xc0000310b8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000c46060?, {0x1875450?, 0xc0004831c0?}, 0x4214c7?, {0x0?, 0x1951d60?, 0xc00068a640?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000c30b40, 0xc00068a6e8?, 0x1864338?}, {0xc000c46060?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004ec260, 0x7f8e18ada108?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0004845e8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004845b8?}, {0x1580a00?, 0xc000094c90?}, {0x12c2180?, 0xc0004845e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x7f8e18ada108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b4dc0, {0x1875450?, 0xc0004831c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002ff8c0, {0x1875450, 0xc0004831c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002ff8c0, 0xc0000cf710)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0004f0140, {0x1875450, 0xc000099940}, 0xc0004ea310, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004844e0, {0xc0004e9340?, 0xc0004b8e60?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0004aa000, {0x1875450, 0xc000099940}, 0xc00068b630, 0xc00068b610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0004aa000, {0x1875450, 0xc000099940})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc000099940?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc000099940?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0000cf170, {0x1875450, 0xc000099940}, {0x22dbca0, 0x1}, {{0x1867f50?, 0xc000483100?}, {0x189d758?, 0xc0004ce840?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00015a000, {0x1875338?, 0xc0005eecc0?}, 0xc0001008c0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc0005eecc0?}, 0xc0002f6fe0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/09 22:55:00  (): java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-5 : panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:36545]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:36545]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:36545], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 33 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0004822c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000c30b40, 0x40a90d?, 0x4383bf?}, {0xc000c46060?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc000c30b40?, 0x0?, 0xc0004c31e0?}, {0xc000c46060?, 0x9ac1c5a643bdf7f?, 0xfd520a0001000000?}, 0x3f164f65822107fc?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000c46060, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000c42120?}, {0x1291680?, 0xc000c42138?}, {0x12c2180?, 0xc0004844c8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b4c80, {0x1875450?, 0xc000483200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002ff680, {0x1875450, 0xc000483200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002ff680, 0xc000c3c990)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1875450?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0002ff680, {0x18?, 0xc000544800?}, 0xc0000310b8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000c46060?, {0x1875450?, 0xc0004831c0?}, 0x4214c7?, {0x0?, 0x1951d60?, 0xc00068a640?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876b60, {0xc000c30b40, 0xc00068a6e8?, 0x1864338?}, {0xc000c46060?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004ec260, 0x7f8e18ada108?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0004845e8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004845b8?}, {0x1580a00?, 0xc000094c90?}, {0x12c2180?, 0xc0004845e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, 0x1}, 0x7f8e18ada108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005b4dc0, {0x1875450?, 0xc0004831c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002ff8c0, {0x1875450, 0xc0004831c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334af0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002ff8c0, 0xc0000cf710)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0004f0140, {0x1875450, 0xc000099940}, 0xc0004ea310, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004844e0, {0xc0004e9340?, 0xc0004b8e60?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0004aa000, {0x1875450, 0xc000099940}, 0xc00068b630, 0xc00068b610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0004aa000, {0x1875450, 0xc000099940})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1875450?, 0xc000099940?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1875450?, 0xc000099940?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0000cf170, {0x1875450, 0xc000099940}, {0x22dbca0, 0x1}, {{0x1867f50?, 0xc000483100?}, {0x189d758?, 0xc0004ce840?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00015a000, {0x1875338?, 0xc0005eecc0?}, 0xc0001008c0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1875338?, 0xc0005eecc0?}, 0xc0002f6fe0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/09 22:55:00 Job state: FAILED
2023/06/09 22:55:00 Failed to execute job: job load0tests0go0flink0batch0cogbk0200609215844-root-0609225341-f51a190f_db29ccec-54e4-49d1-bbaf-259da1fe4465 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200609215844-root-0609225341-f51a190f_db29ccec-54e4-49d1-bbaf-259da1fe4465 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18752c8, 0xc00004c0c0}, {0x16f25f1?, 0x23873b0?}, {0xc000555e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/hwnq43rkhgsyc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #906

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/906/display/redirect>

Changes:


------------------------------------------
[...truncated 57.49 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000039fc8, {0xc0003d5340?, 0xc0000474e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000ff080, {0x18754d0, 0xc00009ad40}, 0xc000389630, 0xc000389610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000ff080, {0x18754d0, 0xc00009ad40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00009ad40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00009ad40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002edb90, {0x18754d0, 0xc00009ad40}, {0x22dbcc0, 0x1}, {{0x1867fd0?, 0xc00039ec80?}, {0x189d7d8?, 0xc0003d82d0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000192000, {0x18753b8?, 0xc0005eecc0?}, 0xc000101220)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0005eecc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-5 : panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:46867]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:46867]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:46867], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 9 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00039e300})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000bea100, 0x40a90d?, 0x4383bf?}, {0xc0007fef00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc000bea100?, 0x0?, 0xc0000071e0?}, {0xc0007fef00?, 0x9ac1c5a643bdf7f?, 0x822f0a0001000000?}, 0x44316f69f9e2cb82?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0007fef00, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc0007fdf38?}, {0x1291680?, 0xc0007fdf50?}, {0x12c2180?, 0xc000039fb0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000fd180, {0x18754d0?, 0xc00039ed80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c6900, {0x18754d0, 0xc00039ed80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c6900, 0xc000888870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x200?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0003c6900, {0x18?, 0xc000478800?}, 0xc000277e78, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0007fef00?, {0x18754d0?, 0xc00039ed40?}, 0x4214c7?, {0x0?, 0x17c6e90?, 0xc000388640?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000bea100, 0xc0003886e8?, 0x18643b8?}, {0xc0007fef00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0002ffbc0, 0x7f8a48342108?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc000011ea8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000011e78?}, {0x1580a00?, 0xc0001a8b10?}, {0x12c2180?, 0xc000011ea8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f8a483425b8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000fd2c0, {0x18754d0?, 0xc00039ed40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c6b40, {0x18754d0, 0xc00039ed40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c6b40, 0xc00047d3b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003c9d60, {0x18754d0, 0xc00009ad40}, 0xc00018e000, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000039fc8, {0xc0003d5340?, 0xc0000474e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000ff080, {0x18754d0, 0xc00009ad40}, 0xc000389630, 0xc000389610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000ff080, {0x18754d0, 0xc00009ad40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00009ad40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00009ad40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002edb90, {0x18754d0, 0xc00009ad40}, {0x22dbcc0, 0x1}, {{0x1867fd0?, 0xc00039ec80?}, {0x189d7d8?, 0xc0003d82d0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000192000, {0x18753b8?, 0xc0005eecc0?}, 0xc000101220)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0005eecc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/08 22:28:50  (): java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-5 : panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:46867]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:46867]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:46867], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 9 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00039e300})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000bea100, 0x40a90d?, 0x4383bf?}, {0xc0007fef00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc000bea100?, 0x0?, 0xc0000071e0?}, {0xc0007fef00?, 0x9ac1c5a643bdf7f?, 0x822f0a0001000000?}, 0x44316f69f9e2cb82?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0007fef00, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc0007fdf38?}, {0x1291680?, 0xc0007fdf50?}, {0x12c2180?, 0xc000039fb0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000fd180, {0x18754d0?, 0xc00039ed80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c6900, {0x18754d0, 0xc00039ed80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c6900, 0xc000888870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x200?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0003c6900, {0x18?, 0xc000478800?}, 0xc000277e78, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0007fef00?, {0x18754d0?, 0xc00039ed40?}, 0x4214c7?, {0x0?, 0x17c6e90?, 0xc000388640?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000bea100, 0xc0003886e8?, 0x18643b8?}, {0xc0007fef00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0002ffbc0, 0x7f8a48342108?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc000011ea8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000011e78?}, {0x1580a00?, 0xc0001a8b10?}, {0x12c2180?, 0xc000011ea8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f8a483425b8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000fd2c0, {0x18754d0?, 0xc00039ed40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c6b40, {0x18754d0, 0xc00039ed40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c6b40, 0xc00047d3b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003c9d60, {0x18754d0, 0xc00009ad40}, 0xc00018e000, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000039fc8, {0xc0003d5340?, 0xc0000474e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000ff080, {0x18754d0, 0xc00009ad40}, 0xc000389630, 0xc000389610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000ff080, {0x18754d0, 0xc00009ad40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00009ad40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00009ad40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002edb90, {0x18754d0, 0xc00009ad40}, {0x22dbcc0, 0x1}, {{0x1867fd0?, 0xc00039ec80?}, {0x189d7d8?, 0xc0003d82d0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000192000, {0x18753b8?, 0xc0005eecc0?}, 0xc000101220)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0005eecc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/08 22:28:51 Job state: FAILED
2023/06/08 22:28:51 Failed to execute job: job load0tests0go0flink0batch0cogbk0200608215343-root-0608222729-7ab9e6a7_05015214-25da-4e59-94be-1be2b9dde6b4 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200608215343-root-0608222729-7ab9e6a7_05015214-25da-4e59-94be-1be2b9dde6b4 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x1875348, 0xc00004c0c0}, {0x16f25f1?, 0x23873d0?}, {0xc000579e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/pejjla6n5ho5u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #905

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/905/display/redirect>

Changes:


------------------------------------------
[...truncated 57.52 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011d70, {0xc0004ed340?, 0xc000163440?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003989a0, {0x18754d0, 0xc000015480}, 0xc0004ed630, 0xc0004ed610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003989a0, {0x18754d0, 0xc000015480})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc000015480?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc000015480?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003ca5a0, {0x18754d0, 0xc000015480}, {0x22dbce8, 0x1}, {{0x1867fd0?, 0xc0003ee100?}, {0x189d7d8?, 0xc0003f01b0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0005c6000, {0x18753b8?, 0xc0005aacc0?}, 0xc000040870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0005aacc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 9: process bundle failed for instruction 9 using plan 1-5 : panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:35461]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:35461]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:35461], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 35 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc000014f00})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000be3090, 0x40a90d?, 0x9d3700?}, {0xc000bfa480?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x8c1306430da6e0eb?, {0xc000be3090?, 0x467926a7ca1bbe53?, 0x6572aa951361f855?}, {0xc000bfa480?, 0x34ccb81aae556572?, 0x82431af7561d9ceb?}, 0xe0d3c2f69301857e?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000bfa480, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000bf12d8?}, {0x1291680?, 0xc000bf12f0?}, {0x12c2180?, 0xc000011d58?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e9680, {0x18754d0?, 0xc0003ee200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c6ea0, {0x18754d0, 0xc0003ee200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c6ea0, 0xc000bf6750)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0003c6ea0, {0x18?, 0x23588a0?}, 0xc000353d18, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000bfa480?, {0x18754d0?, 0xc0003ee1c0?}, 0x4214c7?, {0x0?, 0x200?, 0x100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000be3090, 0xc0004ec6e8?, 0x18643b8?}, {0xc000bfa480?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0003da900, 0x7f5ab55e95b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00011a480)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc00011a0f0?}, {0x1580a00?, 0xc0005b18f0?}, {0x12c2180?, 0xc00011a480?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f5ab55e9108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e97c0, {0x18754d0?, 0xc0003ee1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c70e0, {0x18754d0, 0xc0003ee1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c70e0, 0xc0005dd7a0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003ec460, {0x18754d0, 0xc000015480}, 0xc0002fabd0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011d70, {0xc0004ed340?, 0xc000163440?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003989a0, {0x18754d0, 0xc000015480}, 0xc0004ed630, 0xc0004ed610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003989a0, {0x18754d0, 0xc000015480})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc000015480?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc000015480?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003ca5a0, {0x18754d0, 0xc000015480}, {0x22dbce8, 0x1}, {{0x1867fd0?, 0xc0003ee100?}, {0x189d7d8?, 0xc0003f01b0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0005c6000, {0x18753b8?, 0xc0005aacc0?}, 0xc000040870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0005aacc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/07 22:29:01  (): java.lang.RuntimeException: Error received from SDK harness for instruction 9: process bundle failed for instruction 9 using plan 1-5 : panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:35461]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:35461]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:35461], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{9 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 35 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc000014f00})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000be3090, 0x40a90d?, 0x9d3700?}, {0xc000bfa480?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x8c1306430da6e0eb?, {0xc000be3090?, 0x467926a7ca1bbe53?, 0x6572aa951361f855?}, {0xc000bfa480?, 0x34ccb81aae556572?, 0x82431af7561d9ceb?}, 0xe0d3c2f69301857e?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000bfa480, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000bf12d8?}, {0x1291680?, 0xc000bf12f0?}, {0x12c2180?, 0xc000011d58?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e9680, {0x18754d0?, 0xc0003ee200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c6ea0, {0x18754d0, 0xc0003ee200}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c6ea0, 0xc000bf6750)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0003c6ea0, {0x18?, 0x23588a0?}, 0xc000353d18, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000bfa480?, {0x18754d0?, 0xc0003ee1c0?}, 0x4214c7?, {0x0?, 0x200?, 0x100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000be3090, 0xc0004ec6e8?, 0x18643b8?}, {0xc000bfa480?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0003da900, 0x7f5ab55e95b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00011a480)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc00011a0f0?}, {0x1580a00?, 0xc0005b18f0?}, {0x12c2180?, 0xc00011a480?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f5ab55e9108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e97c0, {0x18754d0?, 0xc0003ee1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0003c70e0, {0x18754d0, 0xc0003ee1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0003c70e0, 0xc0005dd7a0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003ec460, {0x18754d0, 0xc000015480}, 0xc0002fabd0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011d70, {0xc0004ed340?, 0xc000163440?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003989a0, {0x18754d0, 0xc000015480}, 0xc0004ed630, 0xc0004ed610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003989a0, {0x18754d0, 0xc000015480})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc000015480?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc000015480?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003ca5a0, {0x18754d0, 0xc000015480}, {0x22dbce8, 0x1}, {{0x1867fd0?, 0xc0003ee100?}, {0x189d7d8?, 0xc0003f01b0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0005c6000, {0x18753b8?, 0xc0005aacc0?}, 0xc000040870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0005aacc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/07 22:29:01 Job state: FAILED
2023/06/07 22:29:01 Failed to execute job: job load0tests0go0flink0batch0cogbk0200607215436-root-0607222742-855a501f_95fea705-6ee2-441c-aba4-221cbe2a7c0a failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200607215436-root-0607222742-855a501f_95fea705-6ee2-441c-aba4-221cbe2a7c0a failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x1875348, 0xc000126000}, {0x16f25f1?, 0x23873d0?}, {0xc000769e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/bawb5fih6cu4e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #904

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/904/display/redirect>

Changes:


------------------------------------------
[...truncated 57.41 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00027f680, {0xc0003bb340?, 0xc000489f20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003d5e40, {0x18754d0, 0xc00009e000}, 0xc0002a9630, 0xc0002a9610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003d5e40, {0x18754d0, 0xc00009e000})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00009e000?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00009e000?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000411290, {0x18754d0, 0xc00009e000}, {0x22dbca8, 0x1}, {{0x1867fd0?, 0xc0005d4000?}, {0x189d7d8?, 0xc0005c9590?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00008e000, {0x18753b8?, 0xc000564c60?}, 0xc000293540)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc000564c60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 1: process bundle failed for instruction 1 using plan 1-4 : panic: datamgr.go [{1 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-4]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:37891]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:37891]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:37891], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{1 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 45 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0004362c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000b66880, 0x40a90d?, 0x9d3700?}, {0xc000b5f6e0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x13904a0?, {0xc000b66880?, 0xa?, 0xa?}, {0xc000b5f6e0?, 0x5a?, 0x5a?}, 0xc00027f668?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000b5f6e0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000b659e0?}, {0x1291680?, 0xc000b659f8?}, {0x12c2180?, 0xc00027f668?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052b180, {0x18754d0?, 0xc000563b40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000170480, {0x18754d0, 0xc000563b40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000170480, 0xc000b698c0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000170480, {0x18?, 0x23588a0?}, 0xc00026be78, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000b5f6e0?, {0x18754d0?, 0xc000563640?}, 0x4214c7?, {0x0?, 0x200?, 0x80?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000b66880, 0xc0002a86e8?, 0x18643b8?}, {0xc000b5f6e0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0001753b0, 0x7f7b5baa1108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0002dce28)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0002dcdf8?}, {0x1580a00?, 0xc00056b3e0?}, {0x12c2180?, 0xc0002dce28?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f7b5baa1108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052bb80, {0x18754d0?, 0xc000563640}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000170a20, {0x18754d0, 0xc000563640}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000170a20, 0xc0002b5560)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0001e1720, {0x18754d0, 0xc00009e000}, 0xc0004cbea0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00027f680, {0xc0003bb340?, 0xc000489f20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003d5e40, {0x18754d0, 0xc00009e000}, 0xc0002a9630, 0xc0002a9610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003d5e40, {0x18754d0, 0xc00009e000})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00009e000?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00009e000?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000411290, {0x18754d0, 0xc00009e000}, {0x22dbca8, 0x1}, {{0x1867fd0?, 0xc0005d4000?}, {0x189d7d8?, 0xc0005c9590?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00008e000, {0x18753b8?, 0xc000564c60?}, 0xc000293540)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc000564c60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/06 22:28:51  (): java.lang.RuntimeException: Error received from SDK harness for instruction 1: process bundle failed for instruction 1 using plan 1-4 : panic: datamgr.go [{1 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-4]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:37891]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:37891]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:37891], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{1 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 45 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0004362c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000b66880, 0x40a90d?, 0x9d3700?}, {0xc000b5f6e0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x13904a0?, {0xc000b66880?, 0xa?, 0xa?}, {0xc000b5f6e0?, 0x5a?, 0x5a?}, 0xc00027f668?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000b5f6e0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000b659e0?}, {0x1291680?, 0xc000b659f8?}, {0x12c2180?, 0xc00027f668?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052b180, {0x18754d0?, 0xc000563b40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000170480, {0x18754d0, 0xc000563b40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000170480, 0xc000b698c0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000170480, {0x18?, 0x23588a0?}, 0xc00026be78, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000b5f6e0?, {0x18754d0?, 0xc000563640?}, 0x4214c7?, {0x0?, 0x200?, 0x80?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000b66880, 0xc0002a86e8?, 0x18643b8?}, {0xc000b5f6e0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0001753b0, 0x7f7b5baa1108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0002dce28)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0002dcdf8?}, {0x1580a00?, 0xc00056b3e0?}, {0x12c2180?, 0xc0002dce28?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f7b5baa1108?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052bb80, {0x18754d0?, 0xc000563640}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000170a20, {0x18754d0, 0xc000563640}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000170a20, 0xc0002b5560)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0001e1720, {0x18754d0, 0xc00009e000}, 0xc0004cbea0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00027f680, {0xc0003bb340?, 0xc000489f20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003d5e40, {0x18754d0, 0xc00009e000}, 0xc0002a9630, 0xc0002a9610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003d5e40, {0x18754d0, 0xc00009e000})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00009e000?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00009e000?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000411290, {0x18754d0, 0xc00009e000}, {0x22dbca8, 0x1}, {{0x1867fd0?, 0xc0005d4000?}, {0x189d7d8?, 0xc0005c9590?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00008e000, {0x18753b8?, 0xc000564c60?}, 0xc000293540)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc000564c60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/06 22:28:51 Job state: FAILED
2023/06/06 22:28:52 Failed to execute job: job load0tests0go0flink0batch0cogbk0200606215502-root-0606222719-3dd5c6f7_9405a025-8089-499b-a1d0-fc492e4edca1 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200606215502-root-0606222719-3dd5c6f7_9405a025-8089-499b-a1d0-fc492e4edca1 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x1875348, 0xc00004c0c0}, {0x16f25f1?, 0x23873d0?}, {0xc000363e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 13s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/hww6w4mxgez3a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #903

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/903/display/redirect?page=changes>

Changes:

[noreply] Add metric counting finalized rows as reported by BQ (#26989)


------------------------------------------
[...truncated 57.79 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011428, {0xc00040b340?, 0xc000488ec0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00036a160, {0x18754d0, 0xc0004ce880}, 0xc000431630, 0xc000431610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00036a160, {0x18754d0, 0xc0004ce880})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc0004ce880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc0004ce880?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc00030a360, {0x18754d0, 0xc0004ce880}, {0x22dbcb0, 0x1}, {{0x1867fd0?, 0xc000300c00?}, {0x189d7d8?, 0xc00015b410?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00055e000, {0x18753b8?, 0xc00003cc60?}, 0xc000106f50)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc00003cc60?}, 0xc0004c2908?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 2: process bundle failed for instruction 2 using plan 1-5 : panic: datamgr.go [{2 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:36501]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:36501]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:36501], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{2 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 34 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0003bc600})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0004367c0, 0x40a90d?, 0x9ac1c5a643bdf7f?}, {0xc000429080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xa6a2b38c08fa84f8?, {0xc0004367c0?, 0x187b9e8?, 0xc0004c2e68?}, {0xc000429080?, 0xc0000c4fc0?, 0x0?}, 0x46c2a1?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000429080, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000500138?}, {0x1291680?, 0xc000500150?}, {0x12c2180?, 0xc000011410?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000d0a00, {0x18754d0?, 0xc000300d00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000162fc0, {0x18754d0, 0xc000300d00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000162fc0, 0xc000427c20)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000162fc0, {0x18?, 0xc000062800?}, 0xc0004180e8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000429080?, {0x18754d0?, 0xc000300cc0?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0004367c0, 0xc0004306e8?, 0x18643b8?}, {0xc000429080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000358d00, 0x7ff6ca5b25b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0000103d8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000010348?}, {0x1580a00?, 0xc000090b40?}, {0x12c2180?, 0xc0000103d8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000d0b40, {0x18754d0?, 0xc000300cc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000163200, {0x18754d0, 0xc000300cc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000163200, 0xc000682000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc000313f40, {0x18754d0, 0xc0004ce880}, 0xc0006800e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011428, {0xc00040b340?, 0xc000488ec0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00036a160, {0x18754d0, 0xc0004ce880}, 0xc000431630, 0xc000431610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00036a160, {0x18754d0, 0xc0004ce880})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc0004ce880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc0004ce880?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc00030a360, {0x18754d0, 0xc0004ce880}, {0x22dbcb0, 0x1}, {{0x1867fd0?, 0xc000300c00?}, {0x189d7d8?, 0xc00015b410?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00055e000, {0x18753b8?, 0xc00003cc60?}, 0xc000106f50)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc00003cc60?}, 0xc0004c2908?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/05 22:40:42  (): java.lang.RuntimeException: Error received from SDK harness for instruction 2: process bundle failed for instruction 2 using plan 1-5 : panic: datamgr.go [{2 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:36501]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:36501]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:36501], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{2 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 34 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0003bc600})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0004367c0, 0x40a90d?, 0x9ac1c5a643bdf7f?}, {0xc000429080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xa6a2b38c08fa84f8?, {0xc0004367c0?, 0x187b9e8?, 0xc0004c2e68?}, {0xc000429080?, 0xc0000c4fc0?, 0x0?}, 0x46c2a1?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000429080, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc000500138?}, {0x1291680?, 0xc000500150?}, {0x12c2180?, 0xc000011410?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000d0a00, {0x18754d0?, 0xc000300d00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000162fc0, {0x18754d0, 0xc000300d00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000162fc0, 0xc000427c20)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000162fc0, {0x18?, 0xc000062800?}, 0xc0004180e8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000429080?, {0x18754d0?, 0xc000300cc0?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0004367c0, 0xc0004306e8?, 0x18643b8?}, {0xc000429080?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000358d00, 0x7ff6ca5b25b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0000103d8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000010348?}, {0x1580a00?, 0xc000090b40?}, {0x12c2180?, 0xc0000103d8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000d0b40, {0x18754d0?, 0xc000300cc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000163200, {0x18754d0, 0xc000300cc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000163200, 0xc000682000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc000313f40, {0x18754d0, 0xc0004ce880}, 0xc0006800e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011428, {0xc00040b340?, 0xc000488ec0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00036a160, {0x18754d0, 0xc0004ce880}, 0xc000431630, 0xc000431610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00036a160, {0x18754d0, 0xc0004ce880})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc0004ce880?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc0004ce880?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc00030a360, {0x18754d0, 0xc0004ce880}, {0x22dbcb0, 0x1}, {{0x1867fd0?, 0xc000300c00?}, {0x189d7d8?, 0xc00015b410?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00055e000, {0x18753b8?, 0xc00003cc60?}, 0xc000106f50)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc00003cc60?}, 0xc0004c2908?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/05 22:40:42 Job state: FAILED
2023/06/05 22:40:42 Failed to execute job: job load0tests0go0flink0batch0cogbk0200605215938-root-0605223925-6c80af5f_e6eefb5d-e30c-4486-a731-e346aaabd6bd failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200605215938-root-0605223925-6c80af5f_e6eefb5d-e30c-4486-a731-e346aaabd6bd failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x1875348, 0xc000194000}, {0x16f25f1?, 0x23873d0?}, {0xc0000fde60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 5s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/gvj2gc3vj254m

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #902

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/902/display/redirect>

Changes:


------------------------------------------
[...truncated 57.40 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003973f8, {0xc00017d340?, 0xc00013a120?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000130dc0, {0x18754d0, 0xc00031af00}, 0xc000693630, 0xc000693610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000130dc0, {0x18754d0, 0xc00031af00})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00031af00?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00031af00?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003ea870, {0x18754d0, 0xc00031af00}, {0xc00004938c, 0x2}, {{0x1867fd0?, 0xc00012d100?}, {0x189d7d8?, 0xc00030c000?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002fa000, {0x18753b8?, 0xc00053de90?}, 0xc00016d860)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc00053de90?}, 0xc0000c4d80?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 10: process bundle failed for instruction 10 using plan 1-5 : panic: datamgr.go [{10 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:38689]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:38689]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:38689], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{10 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 29 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0005bd180})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0013b94d0, 0x40a90d?, 0x4383bf?}, {0xc000783560?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xffdf3b645a1cac09?, {0xc0013b94d0?, 0x0?, 0xc0005056c0?}, {0xc000783560?, 0x1?, 0x1?}, 0x3c00000000000000?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000783560, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc0010d68e8?}, {0x1291680?, 0xc0010d6900?}, {0x12c2180?, 0xc0003973e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005268c0, {0x18754d0?, 0xc00012d2c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002cc6c0, {0x18754d0, 0xc00012d2c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002cc6c0, 0xc000799560)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x155?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0002cc6c0, {0x18?, 0xc000062800?}, 0xc0003959a8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000783560?, {0x18754d0?, 0xc00012d1c0?}, 0x4214c7?, {0x0?, 0x200?, 0x140?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0013b94d0, 0xc0006926e8?, 0x18643b8?}, {0xc000783560?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0005208d0, 0x7f7eb27ce5b8?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc000626078)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000626048?}, {0x1580a00?, 0xc00057c030?}, {0x12c2180?, 0xc000626078?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000526a00, {0x18754d0?, 0xc00012d1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002cd0e0, {0x18754d0, 0xc00012d1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002cd0e0, 0xc000628000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003f1400, {0x18754d0, 0xc00031af00}, 0xc00049c0e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003973f8, {0xc00017d340?, 0xc00013a120?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000130dc0, {0x18754d0, 0xc00031af00}, 0xc000693630, 0xc000693610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000130dc0, {0x18754d0, 0xc00031af00})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00031af00?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00031af00?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003ea870, {0x18754d0, 0xc00031af00}, {0xc00004938c, 0x2}, {{0x1867fd0?, 0xc00012d100?}, {0x189d7d8?, 0xc00030c000?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002fa000, {0x18753b8?, 0xc00053de90?}, 0xc00016d860)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc00053de90?}, 0xc0000c4d80?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/04 22:28:47  (): java.lang.RuntimeException: Error received from SDK harness for instruction 10: process bundle failed for instruction 10 using plan 1-5 : panic: datamgr.go [{10 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:38689]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:38689]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:38689], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{10 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 29 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc0005bd180})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0013b94d0, 0x40a90d?, 0x4383bf?}, {0xc000783560?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xffdf3b645a1cac09?, {0xc0013b94d0?, 0x0?, 0xc0005056c0?}, {0xc000783560?, 0x1?, 0x1?}, 0x3c00000000000000?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000783560, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc0010d68e8?}, {0x1291680?, 0xc0010d6900?}, {0x12c2180?, 0xc0003973e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0005268c0, {0x18754d0?, 0xc00012d2c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002cc6c0, {0x18754d0, 0xc00012d2c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002cc6c0, 0xc000799560)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x155?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0002cc6c0, {0x18?, 0xc000062800?}, 0xc0003959a8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000783560?, {0x18754d0?, 0xc00012d1c0?}, 0x4214c7?, {0x0?, 0x200?, 0x140?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0013b94d0, 0xc0006926e8?, 0x18643b8?}, {0xc000783560?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0005208d0, 0x7f7eb27ce5b8?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc000626078)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc000626048?}, {0x1580a00?, 0xc00057c030?}, {0x12c2180?, 0xc000626078?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000526a00, {0x18754d0?, 0xc00012d1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0002cd0e0, {0x18754d0, 0xc00012d1c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0002cd0e0, 0xc000628000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003f1400, {0x18754d0, 0xc00031af00}, 0xc00049c0e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003973f8, {0xc00017d340?, 0xc00013a120?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000130dc0, {0x18754d0, 0xc00031af00}, 0xc000693630, 0xc000693610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000130dc0, {0x18754d0, 0xc00031af00})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc00031af00?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc00031af00?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003ea870, {0x18754d0, 0xc00031af00}, {0xc00004938c, 0x2}, {{0x1867fd0?, 0xc00012d100?}, {0x189d7d8?, 0xc00030c000?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002fa000, {0x18753b8?, 0xc00053de90?}, 0xc00016d860)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc00053de90?}, 0xc0000c4d80?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/04 22:28:47 Job state: FAILED
2023/06/04 22:28:47 Failed to execute job: job load0tests0go0flink0batch0cogbk0200604215333-root-0604222726-fc635a15_d2730ea5-db20-42bc-b3c8-ecc44703e122 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200604215333-root-0604222726-fc635a15_d2730ea5-db20-42bc-b3c8-ecc44703e122 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x1875348, 0xc000126000}, {0x16f25f1?, 0x23873d0?}, {0xc00037fe60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/7k4ofme5tb5pg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #901

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/901/display/redirect>

Changes:


------------------------------------------
[...truncated 57.42 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004d9818, {0xc000217340?, 0xc000489840?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003d58c0, {0x18754d0, 0xc000559100}, 0xc00066f630, 0xc00066f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003d58c0, {0x18754d0, 0xc000559100})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc000559100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc000559100?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003733b0, {0x18754d0, 0xc000559100}, {0x22dbcc8, 0x1}, {{0x1867fd0?, 0xc0004a0300?}, {0x189d7d8?, 0xc00021a540?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002fc000, {0x18753b8?, 0xc0004fcc60?}, 0xc0004a4d70)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0004fcc60?}, 0xc0003f7b00?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-4 : panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-4]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:34965]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:34965]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:34965], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 34 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc000400900})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0009135b0, 0x40a90d?, 0xc000012ac8?}, {0xc000925740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc0009135b0?, 0x0?, 0xc00048ab60?}, {0xc000925740?, 0x9ac1c5a643bdf7f?, 0x8b190a0001000000?}, 0x89d443b4155c0fe5?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000925740, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc00092b5c0?}, {0x1291680?, 0xc00092b5d8?}, {0x12c2180?, 0xc0004d9800?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004a8280, {0x18754d0?, 0xc0004a05c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0001647e0, {0x18754d0, 0xc0004a05c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0001647e0, 0xc00092f200)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0001647e0, {0x18?, 0xc000063800?}, 0xc0000b8508, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000925740?, {0x18754d0?, 0xc0004a0580?}, 0x4214c7?, {0x0?, 0x200?, 0x140?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0009135b0, 0xc00066e6e8?, 0x18643b8?}, {0xc000925740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00049f550, 0x7f510f65e5b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0004d9d58)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004d9d28?}, {0x1580a00?, 0xc0004ccc00?}, {0x12c2180?, 0xc0004d9d58?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f510f65e5b8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004a83c0, {0x18754d0?, 0xc0004a0580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000164a20, {0x18754d0, 0xc0004a0580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000164a20, 0xc000373a70)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00008fc20, {0x18754d0, 0xc000559100}, 0xc00052b880, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004d9818, {0xc000217340?, 0xc000489840?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003d58c0, {0x18754d0, 0xc000559100}, 0xc00066f630, 0xc00066f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003d58c0, {0x18754d0, 0xc000559100})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc000559100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc000559100?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003733b0, {0x18754d0, 0xc000559100}, {0x22dbcc8, 0x1}, {{0x1867fd0?, 0xc0004a0300?}, {0x189d7d8?, 0xc00021a540?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002fc000, {0x18753b8?, 0xc0004fcc60?}, 0xc0004a4d70)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0004fcc60?}, 0xc0003f7b00?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/03 22:28:45  (): java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-4 : panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-4]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:34965]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:34965]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:34965], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 34 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc000400900})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0009135b0, 0x40a90d?, 0xc000012ac8?}, {0xc000925740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x0?, {0xc0009135b0?, 0x0?, 0xc00048ab60?}, {0xc000925740?, 0x9ac1c5a643bdf7f?, 0x8b190a0001000000?}, 0x89d443b4155c0fe5?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000925740, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc00092b5c0?}, {0x1291680?, 0xc00092b5d8?}, {0x12c2180?, 0xc0004d9800?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004a8280, {0x18754d0?, 0xc0004a05c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0001647e0, {0x18754d0, 0xc0004a05c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0001647e0, 0xc00092f200)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0001647e0, {0x18?, 0xc000063800?}, 0xc0000b8508, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000925740?, {0x18754d0?, 0xc0004a0580?}, 0x4214c7?, {0x0?, 0x200?, 0x140?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc0009135b0, 0xc00066e6e8?, 0x18643b8?}, {0xc000925740?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00049f550, 0x7f510f65e5b8?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0004d9d58)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004d9d28?}, {0x1580a00?, 0xc0004ccc00?}, {0x12c2180?, 0xc0004d9d58?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f510f65e5b8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004a83c0, {0x18754d0?, 0xc0004a0580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000164a20, {0x18754d0, 0xc0004a0580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000164a20, 0xc000373a70)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00008fc20, {0x18754d0, 0xc000559100}, 0xc00052b880, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0004d9818, {0xc000217340?, 0xc000489840?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003d58c0, {0x18754d0, 0xc000559100}, 0xc00066f630, 0xc00066f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003d58c0, {0x18754d0, 0xc000559100})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc000559100?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc000559100?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003733b0, {0x18754d0, 0xc000559100}, {0x22dbcc8, 0x1}, {{0x1867fd0?, 0xc0004a0300?}, {0x189d7d8?, 0xc00021a540?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0002fc000, {0x18753b8?, 0xc0004fcc60?}, 0xc0004a4d70)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc0004fcc60?}, 0xc0003f7b00?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/03 22:28:46 Job state: FAILED
2023/06/03 22:28:46 Failed to execute job: job load0tests0go0flink0batch0cogbk0200603215337-root-0603222727-df777598_a3b81657-8656-4879-b8f3-f2a5e69d6650 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200603215337-root-0603222727-df777598_a3b81657-8656-4879-b8f3-f2a5e69d6650 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x1875348, 0xc000126000}, {0x16f25f1?, 0x23873d0?}, {0xc00038fe60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 3s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/n7cd2a4owhv5u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #900

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/900/display/redirect?page=changes>

Changes:

[noreply] [Refactor] Beam Python Healthcare Connectors (#26917)


------------------------------------------
[...truncated 57.45 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011938, {0xc00010b340?, 0xc000488bc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e89a0, {0x18754d0, 0xc0003fbc40}, 0xc000367630, 0xc000367610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e89a0, {0x18754d0, 0xc0003fbc40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc0003fbc40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc0003fbc40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000397710, {0x18754d0, 0xc0003fbc40}, {0x22dbce0, 0x1}, {{0x1867fd0?, 0xc000500d40?}, {0x189d7d8?, 0xc000549a10?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000100000, {0x18753b8?, 0xc000548c60?}, 0xc000040c30)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc000548c60?}, 0xc000012358?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 8: process bundle failed for instruction 8 using plan 1-5 : panic: datamgr.go [{8 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:36865]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:36865]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:36865], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{8 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 29 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00034a380})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000fe35f0, 0x40a90d?, 0x4383bf?}, {0xc000ff3d40?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xffdf3b645a1cac09?, {0xc000fe35f0?, 0xc002117f68?, 0xc00050b1e0?}, {0xc000ff3d40?, 0x1?, 0x1?}, 0x3c00000000000000?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000ff3d40, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc001485110?}, {0x1291680?, 0xc001485128?}, {0x12c2180?, 0xc000011920?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00051b540, {0x18754d0?, 0xc000500e40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004eab40, {0x18754d0, 0xc000500e40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004eab40, 0xc001488a20)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0004eab40, {0x18?, 0xc000062800?}, 0xc0003ca248, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000ff3d40?, {0x18754d0?, 0xc000500e00?}, 0x4214c7?, {0x0?, 0x55?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000fe35f0, 0xc0003666e8?, 0x18643b8?}, {0xc000ff3d40?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000373c40, 0x7f26c8961108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000492a20)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004929f0?}, {0x1580a00?, 0xc00054eba0?}, {0x12c2180?, 0xc000492a20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f26c89615b8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00051b680, {0x18754d0?, 0xc000500e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004ead80, {0x18754d0, 0xc000500e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004ead80, 0xc000470000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0002b3040, {0x18754d0, 0xc0003fbc40}, 0xc00051cd90, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011938, {0xc00010b340?, 0xc000488bc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e89a0, {0x18754d0, 0xc0003fbc40}, 0xc000367630, 0xc000367610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e89a0, {0x18754d0, 0xc0003fbc40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc0003fbc40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc0003fbc40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000397710, {0x18754d0, 0xc0003fbc40}, {0x22dbce0, 0x1}, {{0x1867fd0?, 0xc000500d40?}, {0x189d7d8?, 0xc000549a10?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000100000, {0x18753b8?, 0xc000548c60?}, 0xc000040c30)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc000548c60?}, 0xc000012358?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/02 22:30:29  (): java.lang.RuntimeException: Error received from SDK harness for instruction 8: process bundle failed for instruction 8 using plan 1-5 : panic: datamgr.go [{8 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:36865]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:36865]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:36865], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{8 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 29 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1455020, 0xc00034a380})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000fe35f0, 0x40a90d?, 0x4383bf?}, {0xc000ff3d40?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xffdf3b645a1cac09?, {0xc000fe35f0?, 0xc002117f68?, 0xc00050b1e0?}, {0xc000ff3d40?, 0x1?, 0x1?}, 0x3c00000000000000?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000ff3d40, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x1291680?, 0xc001485110?}, {0x1291680?, 0xc001485128?}, {0x12c2180?, 0xc000011920?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00051b540, {0x18754d0?, 0xc000500e40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004eab40, {0x18754d0, 0xc000500e40}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004eab40, 0xc001488a20)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x18754d0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172 +0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0004eab40, {0x18?, 0xc000062800?}, 0xc0003ca248, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000ff3d40?, {0x18754d0?, 0xc000500e00?}, 0x4214c7?, {0x0?, 0x55?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1876be0, {0xc000fe35f0, 0xc0003666e8?, 0x18643b8?}, {0xc000ff3d40?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000373c40, 0x7f26c8961108?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000492a20)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x15299c0?, 0xc0004929f0?}, {0x1580a00?, 0xc00054eba0?}, {0x12c2180?, 0xc000492a20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, 0x1}, 0x7f26c89615b8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00051b680, {0x18754d0?, 0xc000500e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297 +0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004ead80, {0x18754d0, 0xc000500e00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x2334b10, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508 +0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004ead80, 0xc000470000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0002b3040, {0x18754d0, 0xc0003fbc40}, 0xc00051cd90, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011938, {0xc00010b340?, 0xc000488bc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e89a0, {0x18754d0, 0xc0003fbc40}, 0xc000367630, 0xc000367610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e89a0, {0x18754d0, 0xc0003fbc40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18754d0?, 0xc0003fbc40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18754d0?, 0xc0003fbc40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000397710, {0x18754d0, 0xc0003fbc40}, {0x22dbce0, 0x1}, {{0x1867fd0?, 0xc000500d40?}, {0x189d7d8?, 0xc000549a10?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc000100000, {0x18753b8?, 0xc000548c60?}, 0xc000040c30)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18753b8?, 0xc000548c60?}, 0xc000012358?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/02 22:30:30 Job state: FAILED
2023/06/02 22:30:30 Failed to execute job: job load0tests0go0flink0batch0cogbk0200602215338-root-0602222911-7615a8b0_a36c9e20-6e10-42eb-8835-a6dbace8d5a8 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200602215338-root-0602222911-7615a8b0_a36c9e20-6e10-42eb-8835-a6dbace8d5a8 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x1875348, 0xc00004c0c0}, {0x16f25f1?, 0x23873d0?}, {0xc0005b9e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/wmxvj4ueiogws

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #899

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/899/display/redirect>

Changes:


------------------------------------------
[...truncated 57.53 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00059bda0, {0xc0002f83f0?, 0xc0000466c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0001fd760, {0x1870370, 0xc0004af280}, 0xc000345630, 0xc000345610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0001fd760, {0x1870370, 0xc0004af280})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870370?, 0xc0004af280?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870370?, 0xc0004af280?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0001ebdd0, {0x1870370, 0xc0004af280}, {0xc00004943c, 0x2}, {{0x1862e70?, 0xc0002fa040?}, {0x1898638?, 0xc0002f8060?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001f8000, {0x1870258?, 0xc000552c60?}, 0xc0004b7720)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870258?, 0xc000552c60?}, 0xc0000ccd80?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 10: process bundle failed for instruction 10 using plan 1-6 : panic: datamgr.go [{10 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:43665]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:43665]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:43665], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{10 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 43 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451220, 0xc0003163c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc000575210, 0x40a90d?, 0x1?}, {0xc00058c2a0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xf91180e4f5ac9439?, {0xc000575210?, 0xc000012070?, 0xc00004b720?}, {0xc00058c2a0?, 0xc000012090?, 0xc00004b710?}, 0xc00004ae90?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00058c2a0, 0x5a, 0x5a}, 0xc000343b60)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df40?, 0xc0005411d0?}, {0x128df40?, 0xc0005411e8?}, {0x12be7c0?, 0xc00059bd88?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e12c0, {0x1870370?, 0xc0002fa140}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e0dc0, {0x1870370, 0xc0002fa140}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e0dc0, 0xc00058e2d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870370?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000e0dc0, {0x18?, 0x2350880?}, 0xc0002a2248, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00058c2a0?, {0x1870370?, 0xc0002fa100?}, 0x4214c7?, {0x0?, 0x17aaa00?, 0xc0003444e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc000575210, 0xc000344590?, 0x185f258?}, {0xc00058c2a0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0001f5020, 0xc000344798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000696930)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x23)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525440?, 0xc000696900?}, {0x157c1e0?, 0xc0004c1890?}, {0x12be7c0?, 0xc000696930?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e1680, {0x1870370?, 0xc0002fa100}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e1040, {0x1870370, 0xc0002fa100}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e1040, 0xc000691b90)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0002f6a00, {0x1870370, 0xc0004af280}, 0xc000698e00, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00059bda0, {0xc0002f83f0?, 0xc0000466c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0001fd760, {0x1870370, 0xc0004af280}, 0xc000345630, 0xc000345610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0001fd760, {0x1870370, 0xc0004af280})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870370?, 0xc0004af280?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870370?, 0xc0004af280?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0001ebdd0, {0x1870370, 0xc0004af280}, {0xc00004943c, 0x2}, {{0x1862e70?, 0xc0002fa040?}, {0x1898638?, 0xc0002f8060?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001f8000, {0x1870258?, 0xc000552c60?}, 0xc0004b7720)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870258?, 0xc000552c60?}, 0xc0000ccd80?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/06/01 22:29:03  (): java.lang.RuntimeException: Error received from SDK harness for instruction 10: process bundle failed for instruction 10 using plan 1-6 : panic: datamgr.go [{10 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:43665]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:43665]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:43665], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{10 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 43 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451220, 0xc0003163c0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc000575210, 0x40a90d?, 0x1?}, {0xc00058c2a0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xf91180e4f5ac9439?, {0xc000575210?, 0xc000012070?, 0xc00004b720?}, {0xc00058c2a0?, 0xc000012090?, 0xc00004b710?}, 0xc00004ae90?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00058c2a0, 0x5a, 0x5a}, 0xc000343b60)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df40?, 0xc0005411d0?}, {0x128df40?, 0xc0005411e8?}, {0x12be7c0?, 0xc00059bd88?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e12c0, {0x1870370?, 0xc0002fa140}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e0dc0, {0x1870370, 0xc0002fa140}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e0dc0, 0xc00058e2d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870370?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000e0dc0, {0x18?, 0x2350880?}, 0xc0002a2248, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00058c2a0?, {0x1870370?, 0xc0002fa100?}, 0x4214c7?, {0x0?, 0x17aaa00?, 0xc0003444e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc000575210, 0xc000344590?, 0x185f258?}, {0xc00058c2a0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0001f5020, 0xc000344798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000696930)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x23)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525440?, 0xc000696900?}, {0x157c1e0?, 0xc0004c1890?}, {0x12be7c0?, 0xc000696930?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e1680, {0x1870370?, 0xc0002fa100}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e1040, {0x1870370, 0xc0002fa100}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e1040, 0xc000691b90)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0002f6a00, {0x1870370, 0xc0004af280}, 0xc000698e00, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00059bda0, {0xc0002f83f0?, 0xc0000466c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0001fd760, {0x1870370, 0xc0004af280}, 0xc000345630, 0xc000345610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0001fd760, {0x1870370, 0xc0004af280})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870370?, 0xc0004af280?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870370?, 0xc0004af280?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0001ebdd0, {0x1870370, 0xc0004af280}, {0xc00004943c, 0x2}, {{0x1862e70?, 0xc0002fa040?}, {0x1898638?, 0xc0002f8060?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001f8000, {0x1870258?, 0xc000552c60?}, 0xc0004b7720)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870258?, 0xc000552c60?}, 0xc0000ccd80?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/06/01 22:29:03 Job state: FAILED
2023/06/01 22:29:03 Failed to execute job: job load0tests0go0flink0batch0cogbk0200601215341-root-0601222741-3dc9bda0_baf4af5e-36bf-487a-8a34-135592c6ecb8 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200601215341-root-0601222741-3dc9bda0_baf4af5e-36bf-487a-8a34-135592c6ecb8 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701e8, 0xc00004c0c0}, {0x16edf31?, 0x237f3b0?}, {0xc0003bde60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 58s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/bx3ncoec2jqo4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #898

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/898/display/redirect>

Changes:


------------------------------------------
[...truncated 57.85 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00037a558, {0xc0000ed340?, 0xc0004bb2c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00047a420, {0x1870370, 0xc00045e0c0}, 0xc00002d630, 0xc00002d610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00047a420, {0x1870370, 0xc00045e0c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870370?, 0xc00045e0c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870370?, 0xc00045e0c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002102d0, {0x1870370, 0xc00045e0c0}, {0x22d3ca8, 0x1}, {{0x1862e70?, 0xc0002ef9c0?}, {0x1898638?, 0xc00029c4e0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870258?, 0xc000108cc0?}, 0xc000100fa0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870258?, 0xc000108cc0?}, 0xc000012810?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-6 : panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:34641]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:34641]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:34641], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 32 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451220, 0xc0003c9280})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc00152bda0, 0x40a90d?, 0x9ac1c5a643bdf7f?}, {0xc000f87b00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f3b0?, {0xc00152bda0?, 0xa?, 0xa?}, {0xc000f87b00?, 0x5a?, 0x5a?}, 0xc00037a540?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000f87b00, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df40?, 0xc0010309a8?}, {0x128df40?, 0xc0010309c0?}, {0x12be7c0?, 0xc00037a540?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000000500, {0x1870370?, 0xc0002efac0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000000140, {0x1870370, 0xc0002efac0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000000140, 0xc0010321b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1870370?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000000140, {0x18?, 0xc000062400?}, 0xc000033c68, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000f87b00?, {0x1870370?, 0xc0002efa80?}, 0x4214c7?, {0x0?, 0x55?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc00152bda0, 0xc00002c590?, 0x185f258?}, {0xc000f87b00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004d2c80, 0xc0000ec798?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0002a8d68)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525440?, 0xc0002a8d38?}, {0x157c1e0?, 0xc000095560?}, {0x12be7c0?, 0xc0002a8d68?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000000a00, {0x1870370?, 0xc0002efa80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000003c0, {0x1870370, 0xc0002efa80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000003c0, 0xc0004ca120)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00020f180, {0x1870370, 0xc00045e0c0}, 0xc0004edc00, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00037a558, {0xc0000ed340?, 0xc0004bb2c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00047a420, {0x1870370, 0xc00045e0c0}, 0xc00002d630, 0xc00002d610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00047a420, {0x1870370, 0xc00045e0c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870370?, 0xc00045e0c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870370?, 0xc00045e0c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002102d0, {0x1870370, 0xc00045e0c0}, {0x22d3ca8, 0x1}, {{0x1862e70?, 0xc0002ef9c0?}, {0x1898638?, 0xc00029c4e0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870258?, 0xc000108cc0?}, 0xc000100fa0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870258?, 0xc000108cc0?}, 0xc000012810?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/31 22:30:05  (): java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-6 : panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:1:0@localhost:34641]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:1] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:1:0@localhost:34641]] Coder:W;fn/wire/n9_flatten:1:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:34641], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:1:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 32 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451220, 0xc0003c9280})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc00152bda0, 0x40a90d?, 0x9ac1c5a643bdf7f?}, {0xc000f87b00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f3b0?, {0xc00152bda0?, 0xa?, 0xa?}, {0xc000f87b00?, 0x5a?, 0x5a?}, 0xc00037a540?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000f87b00, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df40?, 0xc0010309a8?}, {0x128df40?, 0xc0010309c0?}, {0x12be7c0?, 0xc00037a540?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000000500, {0x1870370?, 0xc0002efac0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000000140, {0x1870370, 0xc0002efac0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000000140, 0xc0010321b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1870370?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000000140, {0x18?, 0xc000062400?}, 0xc000033c68, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000f87b00?, {0x1870370?, 0xc0002efa80?}, 0x4214c7?, {0x0?, 0x55?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a40, {0xc00152bda0, 0xc00002c590?, 0x185f258?}, {0xc000f87b00?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004d2c80, 0xc0000ec798?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0002a8d68)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525440?, 0xc0002a8d38?}, {0x157c1e0?, 0xc000095560?}, {0x12be7c0?, 0xc0002a8d68?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000000a00, {0x1870370?, 0xc0002efa80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000003c0, {0x1870370, 0xc0002efa80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232caf0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000003c0, 0xc0004ca120)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00020f180, {0x1870370, 0xc00045e0c0}, 0xc0004edc00, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00037a558, {0xc0000ed340?, 0xc0004bb2c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00047a420, {0x1870370, 0xc00045e0c0}, 0xc00002d630, 0xc00002d610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00047a420, {0x1870370, 0xc00045e0c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870370?, 0xc00045e0c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870370?, 0xc00045e0c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002102d0, {0x1870370, 0xc00045e0c0}, {0x22d3ca8, 0x1}, {{0x1862e70?, 0xc0002ef9c0?}, {0x1898638?, 0xc00029c4e0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870258?, 0xc000108cc0?}, 0xc000100fa0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870258?, 0xc000108cc0?}, 0xc000012810?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/31 22:30:05 Job state: FAILED
2023/05/31 22:30:05 Failed to execute job: job load0tests0go0flink0batch0cogbk0200531215342-root-0531222847-738e26d9_1cc2fff9-88d3-4b4f-a4f6-5f44e11b204a failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200531215342-root-0531222847-738e26d9_1cc2fff9-88d3-4b4f-a4f6-5f44e11b204a failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701e8, 0xc00004c0c0}, {0x16edf31?, 0x237f3b0?}, {0xc0005dde60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/xjhuhoj7yl4zq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #897

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/897/display/redirect?page=changes>

Changes:

[noreply] Insert graph saving code before `pipeline.run()` instead of replacing it


------------------------------------------
[...truncated 57.49 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00040d290, {0xc000367340?, 0xc0004b9380?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000fa420, {0x1870350, 0xc0002f61c0}, 0xc000765630, 0xc000765610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000fa420, {0x1870350, 0xc0002f61c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870350?, 0xc0002f61c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870350?, 0xc0002f61c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000522360, {0x1870350, 0xc0002f61c0}, {0x22d3ba8, 0x1}, {{0x1862e50?, 0xc0000b14c0?}, {0x1898618?, 0xc00066bc50?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001a6000, {0x1870238?, 0xc000677920?}, 0xc000041d10)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870238?, 0xc000677920?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-6 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:36743]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:36743]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:36743], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 16 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451220, 0xc0004d9140})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a20, {0xc000ae2e70, 0x40a90d?, 0x3f659cc4f210246d?}, {0xc000af6360?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x138c620?, {0xc000ae2e70?, 0x0?, 0x0?}, {0xc000af6360?, 0x0?, 0x0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000af6360, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df40?, 0xc000af8168?}, {0x128df40?, 0xc000af8180?}, {0x12be7c0?, 0xc00040d278?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167a40, {0x1870350?, 0xc0000b15c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167400, {0x1870350, 0xc0000b15c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167400, 0xc000aef4d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870350?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000167400, {0x18?, 0xc000062400?}, 0xc0002734d8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000af6360?, {0x1870350?, 0xc0000b1580?}, 0x4214c7?, {0x0?, 0x191fb50?, 0xc0007644e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a20, {0xc000ae2e70, 0xc000764590?, 0x185f238?}, {0xc000af6360?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00046f270, 0xc000366798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0002e12d8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525440?, 0xc0002e12a8?}, {0x157c1e0?, 0xc000026f90?}, {0x12be7c0?, 0xc0002e12d8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167b80, {0x1870350?, 0xc0000b1580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167900, {0x1870350, 0xc0000b1580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167900, 0xc000035050)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0000a2960, {0x1870350, 0xc0002f61c0}, 0xc000125c00, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00040d290, {0xc000367340?, 0xc0004b9380?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000fa420, {0x1870350, 0xc0002f61c0}, 0xc000765630, 0xc000765610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000fa420, {0x1870350, 0xc0002f61c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870350?, 0xc0002f61c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870350?, 0xc0002f61c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000522360, {0x1870350, 0xc0002f61c0}, {0x22d3ba8, 0x1}, {{0x1862e50?, 0xc0000b14c0?}, {0x1898618?, 0xc00066bc50?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001a6000, {0x1870238?, 0xc000677920?}, 0xc000041d10)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870238?, 0xc000677920?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/30 22:29:00  (): java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-6 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:36743]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:36743]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:36743], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 16 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451220, 0xc0004d9140})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a20, {0xc000ae2e70, 0x40a90d?, 0x3f659cc4f210246d?}, {0xc000af6360?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x138c620?, {0xc000ae2e70?, 0x0?, 0x0?}, {0xc000af6360?, 0x0?, 0x0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000af6360, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df40?, 0xc000af8168?}, {0x128df40?, 0xc000af8180?}, {0x12be7c0?, 0xc00040d278?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167a40, {0x1870350?, 0xc0000b15c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167400, {0x1870350, 0xc0000b15c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167400, 0xc000aef4d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870350?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000167400, {0x18?, 0xc000062400?}, 0xc0002734d8, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000af6360?, {0x1870350?, 0xc0000b1580?}, 0x4214c7?, {0x0?, 0x191fb50?, 0xc0007644e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a20, {0xc000ae2e70, 0xc000764590?, 0x185f238?}, {0xc000af6360?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00046f270, 0xc000366798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc0002e12d8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525440?, 0xc0002e12a8?}, {0x157c1e0?, 0xc000026f90?}, {0x12be7c0?, 0xc0002e12d8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167b80, {0x1870350?, 0xc0000b1580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167900, {0x1870350, 0xc0000b1580}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167900, 0xc000035050)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0000a2960, {0x1870350, 0xc0002f61c0}, 0xc000125c00, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00040d290, {0xc000367340?, 0xc0004b9380?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0000fa420, {0x1870350, 0xc0002f61c0}, 0xc000765630, 0xc000765610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0000fa420, {0x1870350, 0xc0002f61c0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870350?, 0xc0002f61c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870350?, 0xc0002f61c0?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000522360, {0x1870350, 0xc0002f61c0}, {0x22d3ba8, 0x1}, {{0x1862e50?, 0xc0000b14c0?}, {0x1898618?, 0xc00066bc50?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001a6000, {0x1870238?, 0xc000677920?}, 0xc000041d10)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870238?, 0xc000677920?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/30 22:29:00 Job state: FAILED
2023/05/30 22:29:01 Failed to execute job: job load0tests0go0flink0batch0cogbk0200530215326-root-0530222739-b9d7a2a3_c848cda6-f2f5-41e8-94b9-d3fcd72a9521 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200530215326-root-0530222739-b9d7a2a3_c848cda6-f2f5-41e8-94b9-d3fcd72a9521 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701c8, 0xc000126000}, {0x16edf18?, 0x237f290?}, {0xc000383e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/n7x3lyugqeyfi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #896

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/896/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #26919: warn if BigQuery failed rows collection is


------------------------------------------
[...truncated 57.42 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000593308, {0xc0002df340?, 0xc0002f0060?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00025db80, {0x1870330, 0xc00049f080}, 0xc0007d3630, 0xc0007d3610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00025db80, {0x1870330, 0xc00049f080})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc00049f080?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc00049f080?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003d87e0, {0x1870330, 0xc00049f080}, {0x22d3ba8, 0x1}, {{0x1862e30?, 0xc00055aa40?}, {0x18985f8?, 0xc0005691a0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00028c000, {0x1870218?, 0xc000568c60?}, 0xc0004a7590)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc000568c60?}, 0xc000405680?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-6 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:44641]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:44641]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:44641], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 30 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc00049efc0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006cee70, 0x40a90d?, 0xc000529610?}, {0xc0006d7500?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xfae1a556b13ab2eb?, {0xc0006cee70?, 0xea9c125341225548?, 0xc0000a7140?}, {0xc0006d7500?, 0xc0000a7080?, 0xc00012bce0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0006d7500, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc0006dda88?}, {0x128df20?, 0xc0006ddaa0?}, {0x12be7a0?, 0xc0005932f0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052b680, {0x1870330?, 0xc00055ac00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00052b2c0, {0x1870330, 0xc00055ac00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00052b2c0, 0xc0006e2ea0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00052b2c0, {0x18?, 0xc000062800?}, 0xc000106038, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0006d7500?, {0x1870330?, 0xc00055abc0?}, 0x4214c7?, {0x0?, 0x200?, 0xc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006cee70, 0xc0007d2590?, 0x185f218?}, {0xc0006d7500?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000184ea0, 0xc0002de798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000593db8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc000593d88?}, {0x157c1c0?, 0xc00049b0b0?}, {0x12be7a0?, 0xc000593db8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052b7c0, {0x1870330?, 0xc00055abc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00052b540, {0x1870330, 0xc00055abc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00052b540, 0xc0002e8fc0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0001001e0, {0x1870330, 0xc00049f080}, 0xc00052efc0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000593308, {0xc0002df340?, 0xc0002f0060?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00025db80, {0x1870330, 0xc00049f080}, 0xc0007d3630, 0xc0007d3610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00025db80, {0x1870330, 0xc00049f080})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc00049f080?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc00049f080?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003d87e0, {0x1870330, 0xc00049f080}, {0x22d3ba8, 0x1}, {{0x1862e30?, 0xc00055aa40?}, {0x18985f8?, 0xc0005691a0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00028c000, {0x1870218?, 0xc000568c60?}, 0xc0004a7590)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc000568c60?}, 0xc000405680?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/29 22:28:48  (): java.lang.RuntimeException: Error received from SDK harness for instruction 5: process bundle failed for instruction 5 using plan 1-6 : panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:44641]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:44641]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:44641], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{5 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 30 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc00049efc0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006cee70, 0x40a90d?, 0xc000529610?}, {0xc0006d7500?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xfae1a556b13ab2eb?, {0xc0006cee70?, 0xea9c125341225548?, 0xc0000a7140?}, {0xc0006d7500?, 0xc0000a7080?, 0xc00012bce0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0006d7500, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc0006dda88?}, {0x128df20?, 0xc0006ddaa0?}, {0x12be7a0?, 0xc0005932f0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052b680, {0x1870330?, 0xc00055ac00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00052b2c0, {0x1870330, 0xc00055ac00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00052b2c0, 0xc0006e2ea0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc00052b2c0, {0x18?, 0xc000062800?}, 0xc000106038, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0006d7500?, {0x1870330?, 0xc00055abc0?}, 0x4214c7?, {0x0?, 0x200?, 0xc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006cee70, 0xc0007d2590?, 0x185f218?}, {0xc0006d7500?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc000184ea0, 0xc0002de798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc000593db8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc000593d88?}, {0x157c1c0?, 0xc00049b0b0?}, {0x12be7a0?, 0xc000593db8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc00052b7c0, {0x1870330?, 0xc00055abc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc00052b540, {0x1870330, 0xc00055abc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc00052b540, 0xc0002e8fc0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0001001e0, {0x1870330, 0xc00049f080}, 0xc00052efc0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000593308, {0xc0002df340?, 0xc0002f0060?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00025db80, {0x1870330, 0xc00049f080}, 0xc0007d3630, 0xc0007d3610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00025db80, {0x1870330, 0xc00049f080})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc00049f080?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc00049f080?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003d87e0, {0x1870330, 0xc00049f080}, {0x22d3ba8, 0x1}, {{0x1862e30?, 0xc00055aa40?}, {0x18985f8?, 0xc0005691a0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00028c000, {0x1870218?, 0xc000568c60?}, 0xc0004a7590)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc000568c60?}, 0xc000405680?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/29 22:28:49 Job state: FAILED
2023/05/29 22:28:49 Failed to execute job: job load0tests0go0flink0batch0cogbk0200529215314-root-0529222724-58313f47_381c41bc-2080-40d9-b2a2-14f35f8c4dea failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200529215314-root-0529222724-58313f47_381c41bc-2080-40d9-b2a2-14f35f8c4dea failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701a8, 0xc000126000}, {0x16edef8?, 0x237f290?}, {0xc000391e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/womdqwqissu5g

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #895

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/895/display/redirect>

Changes:


------------------------------------------
[...truncated 57.47 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00048d950, {0xc000563340?, 0xc0001602e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003cb600, {0x1870330, 0xc00053be80}, 0xc00060f630, 0xc00060f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003cb600, {0x1870330, 0xc00053be80})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc00053be80?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc00053be80?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000564240, {0x1870330, 0xc00053be80}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc000568200?}, {0x18985f8?, 0xc000552ea0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870218?, 0xc0006578f0?}, 0xc000040a00)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc0006578f0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-6 : panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:32777]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:32777]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:32777], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 41 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc00043a340})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006ce640, 0x40a90d?, 0xd18c4903678ccab1?}, {0xc0006cafc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xc00010e2a0?, {0xc0006ce640?, 0xc000122fc0?, 0xc000123140?}, {0xc0006cafc0?, 0xc000123080?, 0xc0001cbce0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0006cafc0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc0006d6270?}, {0x128df20?, 0xc0006d6288?}, {0x12be7a0?, 0xc00048d938?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000516640, {0x1870330?, 0xc000568300}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000516280, {0x1870330, 0xc000568300}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000516280, 0xc0006d4630)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000516280, {0x18?, 0x2350760?}, 0xc0003b3638, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0006cafc0?, {0x1870330?, 0xc0005682c0?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006ce640, 0xc00060e590?, 0x185f218?}, {0xc0006cafc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004f54f0, 0xc00060e798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00048d200)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x414825)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc00048d1d0?}, {0x157c1c0?, 0xc000538900?}, {0x12be7a0?, 0xc00048d200?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000516780, {0x1870330?, 0xc0005682c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000516500, {0x1870330, 0xc0005682c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000516500, 0xc000565050)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00055b860, {0x1870330, 0xc00053be80}, 0xc0005da690, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00048d950, {0xc000563340?, 0xc0001602e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003cb600, {0x1870330, 0xc00053be80}, 0xc00060f630, 0xc00060f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003cb600, {0x1870330, 0xc00053be80})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc00053be80?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc00053be80?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000564240, {0x1870330, 0xc00053be80}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc000568200?}, {0x18985f8?, 0xc000552ea0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870218?, 0xc0006578f0?}, 0xc000040a00)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc0006578f0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/28 22:28:46  (): java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-6 : panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:32777]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:32777]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:32777], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 41 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc00043a340})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006ce640, 0x40a90d?, 0xd18c4903678ccab1?}, {0xc0006cafc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0xc00010e2a0?, {0xc0006ce640?, 0xc000122fc0?, 0xc000123140?}, {0xc0006cafc0?, 0xc000123080?, 0xc0001cbce0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc0006cafc0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc0006d6270?}, {0x128df20?, 0xc0006d6288?}, {0x12be7a0?, 0xc00048d938?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000516640, {0x1870330?, 0xc000568300}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000516280, {0x1870330, 0xc000568300}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000516280, 0xc0006d4630)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000516280, {0x18?, 0x2350760?}, 0xc0003b3638, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc0006cafc0?, {0x1870330?, 0xc0005682c0?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0006ce640, 0xc00060e590?, 0x185f218?}, {0xc0006cafc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004f54f0, 0xc00060e798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00048d200)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x414825)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc00048d1d0?}, {0x157c1c0?, 0xc000538900?}, {0x12be7a0?, 0xc00048d200?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000516780, {0x1870330?, 0xc0005682c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000516500, {0x1870330, 0xc0005682c0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000516500, 0xc000565050)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc00055b860, {0x1870330, 0xc00053be80}, 0xc0005da690, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc00048d950, {0xc000563340?, 0xc0001602e0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003cb600, {0x1870330, 0xc00053be80}, 0xc00060f630, 0xc00060f610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003cb600, {0x1870330, 0xc00053be80})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc00053be80?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc00053be80?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000564240, {0x1870330, 0xc00053be80}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc000568200?}, {0x18985f8?, 0xc000552ea0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870218?, 0xc0006578f0?}, 0xc000040a00)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc0006578f0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/28 22:28:47 Job state: FAILED
2023/05/28 22:28:47 Failed to execute job: job load0tests0go0flink0batch0cogbk0200528215329-root-0528222727-cb4d9a3f_4cde4696-7622-4c67-93cf-74aed6c2b5f1 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200528215329-root-0528222727-cb4d9a3f_4cde4696-7622-4c67-93cf-74aed6c2b5f1 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701a8, 0xc00004c0c0}, {0x16edef8?, 0x237f290?}, {0xc00054de60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/6efvjinj3khr4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #894

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/894/display/redirect>

Changes:


------------------------------------------
[...truncated 57.49 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011bd8, {0xc0003d3340?, 0xc000047680?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00056d1e0, {0x1870330, 0xc0003de380}, 0xc000623630, 0xc000623610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00056d1e0, {0x1870330, 0xc0003de380})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc0003de380?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc0003de380?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0004fcab0, {0x1870330, 0xc0003de380}, {0x22d3bb8, 0x1}, {{0x1862e30?, 0xc000525b00?}, {0x18985f8?, 0xc0002f5110?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870218?, 0xc00020ecc0?}, 0xc0000418b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc00020ecc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 7: process bundle failed for instruction 7 using plan 1-6 : panic: datamgr.go [{7 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:44893]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:44893]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:44893], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{7 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 46 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc00039c200})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000bb4420, 0x40a90d?, 0xc00026cde0?}, {0xc000baecc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f290?, {0xc000bb4420?, 0xa?, 0xa?}, {0xc000baecc0?, 0x5a?, 0x5a?}, 0xc000011bc0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000baecc0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc000bb6b88?}, {0x128df20?, 0xc000bb6ba0?}, {0x12be7a0?, 0xc000011bc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167a40, {0x1870330?, 0xc000525c00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167180, {0x1870330, 0xc000525c00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167180, 0xc000bb8990)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000167180, {0x18?, 0xc000062400?}, 0xc0005f2248, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000baecc0?, {0x1870330?, 0xc000525bc0?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000bb4420, 0xc000622590?, 0x185f218?}, {0xc000baecc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004d3950, 0xc0003d2798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00011bab8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc00011ba88?}, {0x157c1c0?, 0xc000522d80?}, {0x12be7a0?, 0xc00011bab8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167b80, {0x1870330?, 0xc000525bc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167900, {0x1870330, 0xc000525bc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167900, 0xc0004fd4d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003d8000, {0x1870330, 0xc0003de380}, 0xc00018f650, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011bd8, {0xc0003d3340?, 0xc000047680?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00056d1e0, {0x1870330, 0xc0003de380}, 0xc000623630, 0xc000623610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00056d1e0, {0x1870330, 0xc0003de380})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc0003de380?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc0003de380?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0004fcab0, {0x1870330, 0xc0003de380}, {0x22d3bb8, 0x1}, {{0x1862e30?, 0xc000525b00?}, {0x18985f8?, 0xc0002f5110?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870218?, 0xc00020ecc0?}, 0xc0000418b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc00020ecc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/27 22:30:15  (): java.lang.RuntimeException: Error received from SDK harness for instruction 7: process bundle failed for instruction 7 using plan 1-6 : panic: datamgr.go [{7 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-6]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:44893]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:44893]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:44893], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{7 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 46 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc00039c200})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000bb4420, 0x40a90d?, 0xc00026cde0?}, {0xc000baecc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f290?, {0xc000bb4420?, 0xa?, 0xa?}, {0xc000baecc0?, 0x5a?, 0x5a?}, 0xc000011bc0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000baecc0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc000bb6b88?}, {0x128df20?, 0xc000bb6ba0?}, {0x12be7a0?, 0xc000011bc0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167a40, {0x1870330?, 0xc000525c00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167180, {0x1870330, 0xc000525c00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167180, 0xc000bb8990)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x4273c0?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000167180, {0x18?, 0xc000062400?}, 0xc0005f2248, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000baecc0?, {0x1870330?, 0xc000525bc0?}, 0x4214c7?, {0x0?, 0x200?, 0x40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000bb4420, 0xc000622590?, 0x185f218?}, {0xc000baecc0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0004d3950, 0xc0003d2798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00011bab8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc00011ba88?}, {0x157c1c0?, 0xc000522d80?}, {0x12be7a0?, 0xc00011bab8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc000167b80, {0x1870330?, 0xc000525bc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000167900, {0x1870330, 0xc000525bc0}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000167900, 0xc0004fd4d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003d8000, {0x1870330, 0xc0003de380}, 0xc00018f650, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc000011bd8, {0xc0003d3340?, 0xc000047680?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc00056d1e0, {0x1870330, 0xc0003de380}, 0xc000623630, 0xc000623610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc00056d1e0, {0x1870330, 0xc0003de380})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc0003de380?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc0003de380?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0004fcab0, {0x1870330, 0xc0003de380}, {0x22d3bb8, 0x1}, {{0x1862e30?, 0xc000525b00?}, {0x18985f8?, 0xc0002f5110?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00027c000, {0x1870218?, 0xc00020ecc0?}, 0xc0000418b0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc00020ecc0?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/27 22:30:16 Job state: FAILED
2023/05/27 22:30:16 Failed to execute job: job load0tests0go0flink0batch0cogbk0200527215332-root-0527222847-df6f15f_c6824e16-e67c-4314-bc80-8ffc9c749e12 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200527215332-root-0527222847-df6f15f_c6824e16-e67c-4314-bc80-8ffc9c749e12 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701a8, 0xc00004c0c0}, {0x16edef8?, 0x237f290?}, {0xc000363e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/zovo627yp7t6q

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #893

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/893/display/redirect>

Changes:


------------------------------------------
[...truncated 38.65 KB...]
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c11"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c10"
    >
  >
  coders: <
    key: "c12"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c11"
    >
  >
  coders: <
    key: "c13"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\021\n\013num_records\032\002\020\004\n\024\n\016initial_splits\032\002\020\004\n\016\n\010key_size\032\002\020\004\n\020\n\nvalue_size\032\002\020\004\n\022\n\014num_hot_keys\032\002\020\004\n\026\n\020hot_key_fraction\032\002\020\006\022$f691cccd-3963-4ed9-9f25-d9fdfd07b30d"
      >
    >
  >
  coders: <
    key: "c14"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "ChdvZmZzZXRyYW5nZS5SZXN0cmljdGlvbhJTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24atAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdEVuYxJlCBYiUwgaSk9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vaW8vcnRyYWNrZXJzL29mZnNldHJhbmdlLlJlc3RyaWN0aW9uKgYIFBICCAgqBAgZQAEitAEKS2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UucmVzdERlYxJlCBYiBggUEgIICCpTCBpKT2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9pby9ydHJhY2tlcnMvb2Zmc2V0cmFuZ2UuUmVzdHJpY3Rpb24qBAgZQAE="
      >
    >
  >
  coders: <
    key: "c15"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c14"
    >
  >
  coders: <
    key: "c16"
    value: <
      spec: <
        urn: "beam:coder:bool:v1"
      >
    >
  >
  coders: <
    key: "c17"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c15"
      component_coder_ids: "c16"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhpdCklnaXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvdjIvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5lbmNWYXJJbnRaEhAIFiIECBlADyoGCBQSAggIImkKSWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy92Mi9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmRlY1ZhckludFoSHAgWIgQIGUADIgYIFBICCAgqBAgZQA8qBAgZQAE="
      >
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c4"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c5"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c5"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c7"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:go:coder:cogbklist:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n6gcr.io/apache-beam-testing/beam-sdk/beam_go_sdk:latest"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:****_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.49.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2023/05/26 22:28:07 Using specified **** binary: 'linux_amd64/cogbk'
2023/05/26 22:28:07 Prepared job with id: load-tests-go-flink-batch-cogbk-2-0526215406_9a0e452e-9703-4d88-99ba-92ae03e31d50 and staging token: load-tests-go-flink-batch-cogbk-2-0526215406_9a0e452e-9703-4d88-99ba-92ae03e31d50
2023/05/26 22:28:14 Staged binary artifact with token: 
2023/05/26 22:28:15 Submitted job: load0tests0go0flink0batch0cogbk0200526215406-root-0526222814-57588105_cfa91780-ce21-4283-aa03-a5dc918948e5
2023/05/26 22:28:15 Job state: STOPPED
2023/05/26 22:28:15 Job state: STARTING
2023/05/26 22:28:15 Job state: RUNNING
2023/05/27 06:15:01 Failed to execute job: failed to get metrics
	caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:8099: connect: connection refused"
	caused by:
rpc error: code = Unavailable desc = error reading from server: EOF
panic: Failed to execute job: failed to get metrics
	caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:8099: connect: connection refused"
	caused by:
rpc error: code = Unavailable desc = error reading from server: EOF

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701a8, 0xc000126000}, {0x16edef8?, 0x237f290?}, {0xc0005ede60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 7h 47m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/yil4flzxzxxmq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #892

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/892/display/redirect>

Changes:


------------------------------------------
[...truncated 57.46 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003bdb90, {0xc0001f1340?, 0xc000047c20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e1340, {0x1870330, 0xc000569800}, 0xc00044b630, 0xc00044b610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e1340, {0x1870330, 0xc000569800})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc000569800?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc000569800?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003f9560, {0x1870330, 0xc000569800}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc00040b780?}, {0x18985f8?, 0xc0001f6ea0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00028c000, {0x1870218?, 0xc00056ac60?}, 0xc0004a76d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc00056ac60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-3 : panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-3]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:42983]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:42983]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:42983], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 34 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc000212300})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000418740, 0x40a90d?, 0x4383bf?}, {0xc00041cba0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f290?, {0xc000418740?, 0xa?, 0xa?}, {0xc00041cba0?, 0x5a?, 0x5a?}, 0xc0003bdb78?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00041cba0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc000541320?}, {0x128df20?, 0xc000541338?}, {0x12be7a0?, 0xc0003bdb78?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e1900, {0x1870330?, 0xc00025ff00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e1180, {0x1870330, 0xc00025ff00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e1180, 0xc00046e750)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000e1180, {0x18?, 0xc000062400?}, 0xc000401f28, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00041cba0?, {0x1870330?, 0xc00025fe80?}, 0x0?, {0x0?, 0xaba5ba96b8e1beac?, 0x72265594494bd856?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000418740, 0xc00044a590?, 0x185f218?}, {0xc00041cba0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00023df60, 0xc0001f0798?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0004d26c0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc0004d2690?}, {0x157c1c0?, 0xc00049b4d0?}, {0x12be7a0?, 0xc0004d26c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e1a40, {0x1870330?, 0xc00025fe80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e17c0, {0x1870330, 0xc00025fe80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e17c0, 0xc000314bd0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc000098280, {0x1870330, 0xc000569800}, 0xc0003d9ce0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003bdb90, {0xc0001f1340?, 0xc000047c20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e1340, {0x1870330, 0xc000569800}, 0xc00044b630, 0xc00044b610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e1340, {0x1870330, 0xc000569800})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc000569800?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc000569800?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003f9560, {0x1870330, 0xc000569800}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc00040b780?}, {0x18985f8?, 0xc0001f6ea0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00028c000, {0x1870218?, 0xc00056ac60?}, 0xc0004a76d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc00056ac60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/25 22:28:59  (): java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-3 : panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-3]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:42983]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:42983]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n4_e9_inject0] Out:[4]
6: Inject[0]. Out:5
7: PCollection[n4] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n3] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:42983], local_output] Out:10 Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 34 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc000212300})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000418740, 0x40a90d?, 0x4383bf?}, {0xc00041cba0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f290?, {0xc000418740?, 0xa?, 0xa?}, {0xc00041cba0?, 0x5a?, 0x5a?}, 0xc0003bdb78?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00041cba0, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc000541320?}, {0x128df20?, 0xc000541338?}, {0x12be7a0?, 0xc0003bdb78?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e1900, {0x1870330?, 0xc00025ff00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e1180, {0x1870330, 0xc00025ff00}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e1180, 0xc00046e750)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000e1180, {0x18?, 0xc000062400?}, 0xc000401f28, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00041cba0?, {0x1870330?, 0xc00025fe80?}, 0x0?, {0x0?, 0xaba5ba96b8e1beac?, 0x72265594494bd856?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc000418740, 0xc00044a590?, 0x185f218?}, {0xc00041cba0?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00023df60, 0xc0001f0798?, {0x1312d00, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0xc0004d26c0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1312d00?, 0x1, 0xa, 0x5a, 0x5, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc0004d2690?}, {0x157c1c0?, 0xc00049b4d0?}, {0x12be7a0?, 0xc0004d26c0?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000e1a40, {0x1870330?, 0xc00025fe80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000e17c0, {0x1870330, 0xc00025fe80}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000e17c0, 0xc000314bd0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc000098280, {0x1870330, 0xc000569800}, 0xc0003d9ce0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003bdb90, {0xc0001f1340?, 0xc000047c20?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e1340, {0x1870330, 0xc000569800}, 0xc00044b630, 0xc00044b610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e1340, {0x1870330, 0xc000569800})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc000569800?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc000569800?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003f9560, {0x1870330, 0xc000569800}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc00040b780?}, {0x18985f8?, 0xc0001f6ea0?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00028c000, {0x1870218?, 0xc00056ac60?}, 0xc0004a76d0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc00056ac60?}, 0x0?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/25 22:28:59 Job state: FAILED
2023/05/25 22:28:59 Failed to execute job: job load0tests0go0flink0batch0cogbk0200525221753-root-0525222741-efb3cd2a_2eb7ced7-4753-4655-a732-9f7a759e3981 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200525221753-root-0525222741-efb3cd2a_2eb7ced7-4753-4655-a732-9f7a759e3981 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701a8, 0xc00004c0c0}, {0x16edef8?, 0x237f290?}, {0xc000139e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/umi26od5hg6b4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Flink_batch #891

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/891/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #26878: make sure that we capture all writes to the


------------------------------------------
[...truncated 57.52 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0005c0900, {0xc00032f340?, 0xc000046260?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000176dc0, {0x1870330, 0xc0000d2d40}, 0xc0003b7630, 0xc0003b7610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000176dc0, {0x1870330, 0xc0000d2d40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc0000d2d40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc0000d2d40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003c4870, {0x1870330, 0xc0000d2d40}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc000500e80?}, {0x18985f8?, 0xc0002ccb40?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00023c000, {0x1870218?, 0xc0005c7cb0?}, 0xc0001f8870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc0005c7cb0?}, 0xc0005ce298?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
	at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
	at org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
	at org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
	at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-2 : panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-2]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:41273]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:41273]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:41273], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 36 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc000432ac0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0003fa500, 0x40a90d?, 0xc00004a890?}, {0xc00104c960?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f290?, {0xc0003fa500?, 0xa?, 0xa?}, {0xc00104c960?, 0x5a?, 0x5a?}, 0xc0005c08e8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00104c960, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc00104b770?}, {0x128df20?, 0xc00104b788?}, {0x12be7a0?, 0xc0005c08e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004b3040, {0x1870330?, 0xc000501080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004b2b40, {0x1870330, 0xc000501080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004b2b40, 0xc000ff3a70)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0004b2b40, {0x18?, 0xc000062800?}, 0xc000536a88, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00104c960?, {0x1870330?, 0xc000501040?}, 0x4214c7?, {0x0?, 0x1706f58?, 0xc0003b64e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0003fa500, 0xc0003b6590?, 0x185f218?}, {0xc00104c960?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0005cac00, 0xc0003b6798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00028c0a8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc00028c078?}, {0x157c1c0?, 0xc00052a150?}, {0x12be7a0?, 0xc00028c0a8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004b3180, {0x1870330?, 0xc000501040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004b2f00, {0x1870330, 0xc000501040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004b2f00, 0xc000362000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003dbae0, {0x1870330, 0xc0000d2d40}, 0xc0004d20e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0005c0900, {0xc00032f340?, 0xc000046260?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000176dc0, {0x1870330, 0xc0000d2d40}, 0xc0003b7630, 0xc0003b7610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000176dc0, {0x1870330, 0xc0000d2d40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc0000d2d40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc0000d2d40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003c4870, {0x1870330, 0xc0000d2d40}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc000500e80?}, {0x18985f8?, 0xc0002ccb40?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00023c000, {0x1870218?, 0xc0005c7cb0?}, 0xc0001f8870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc0005c7cb0?}, 0xc0005ce298?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d

	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
	at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	... 1 more
2023/05/24 22:28:49  (): java.lang.RuntimeException: Error received from SDK harness for instruction 4: process bundle failed for instruction 4 using plan 1-2 : panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc = 
Full error:
while executing Process for Plan[1-2]:
2: DataSink[S[fn/write/n9_flatten:0:0@localhost:41273]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
3: PCollection[n9_flatten:0] Out:[2]
4: Flatten[1]. Out:DataSink[S[fn/write/n9_flatten:0:0@localhost:41273]] Coder:W;fn/wire/n9_flatten:0:0<KV;c6<bytes;c0,KV;c5<int[varintz;c3];c4,bytes;c0>>>!GWC
5: PCollection[n8_e9_inject1] Out:[4]
6: Inject[1]. Out:5
7: PCollection[n8] Out:[6]
8: ParDo[load.RuntimeMonitor] Out:[7] Sig: func([]uint8, []uint8, func([]uint8, []uint8))
9: PCollection[n7] Out:[8]
10: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:10 Out:[9]
1: DataSource[S[fn/read/n6/SplitAndSize0:0@localhost:41273], local_output] Out:10 Coder:W;fn/wire/n6/SplitAndSize0:0<KV;c13/SplitAndSize0<KV;c13/PairWithRestriction0<R;c13[synthetic.SourceConfig],KV;c17<offsetrange.Restriction[offsetrange.Restriction;c14];c15,bool;c16>>,double;DoubleCoder0>>!GWC 
	caused by:
panic: datamgr.go [{4 fn/write/n9_flatten:0:0}]: error flushing buffer of length 3999964
	caused by:
rpc error: code = Unknown desc =  goroutine 36 [running]:
runtime/debug.Stack()
	/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58 +0xa5
panic({0x1451200, 0xc000432ac0})
	/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0003fa500, 0x40a90d?, 0xc00004a890?}, {0xc00104c960?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81 +0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x237f290?, {0xc0003fa500?, 0xa?, 0xa?}, {0xc00104c960?, 0x5a?, 0x5a?}, 0xc0005c08e8?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/util.go>:87 +0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc00104c960, 0x5a, 0x5a}, 0x46eb0a)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469 +0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c383?, {0x128df20?, 0xc00104b770?}, {0x128df20?, 0xc00104b788?}, {0x12be7a0?, 0xc0005c08e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458 +0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55 +0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004b3040, {0x1870330?, 0xc000501080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004b2b40, {0x1870330, 0xc000501080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004b2b40, 0xc000ff3a70)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x55?, 0x1870330?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:168 +0x5c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0004b2b40, {0x18?, 0xc000062800?}, 0xc000536a88, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:153 +0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc00104c960?, {0x1870330?, 0xc000501040?}, 0x4214c7?, {0x0?, 0x1706f58?, 0xc0003b64e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100 +0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x1871a00, {0xc0003fa500, 0xc0003b6590?, 0x185f218?}, {0xc00104c960?, 0x5a, 0x5a})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80 +0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc0005cac00, 0xc0003b6798?, {0x1e8480, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0xc00028c0a8)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151 +0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0x1e8480?, 0x1, 0xa, 0x5a, 0x3e8, 0x3ff0000000000000}, 0x0)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382 +0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?, {0x1525420?, 0xc00028c078?}, {0x157c1c0?, 0xc00052a150?}, {0x12be7a0?, 0xc00028c0a8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371 +0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, 0x1}, 0x12?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109 +0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0004b3180, {0x1870330?, 0xc000501040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:301 +0x1132
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0004b2f00, {0x1870330, 0xc000501040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x232c9d0, 0x1, ...}, ...)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:419 +0x2de
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0004b2f00, 0xc000362000)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:190 +0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc0003dbae0, {0x1870330, 0xc0000d2d40}, 0xc0004d20e0, {0x0, 0x0, 0x0})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556 +0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0005c0900, {0xc00032f340?, 0xc000046260?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241 +0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc000176dc0, {0x1870330, 0xc0000d2d40}, 0xc0003b7630, 0xc0003b7610)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147 +0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000176dc0, {0x1870330, 0xc0000d2d40})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215 +0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x1870330?, 0xc0000d2d40?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151 +0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x1870330?, 0xc0000d2d40?}, 0x415d50?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62 +0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0003c4870, {0x1870330, 0xc0000d2d40}, {0x22d3ba0, 0x1}, {{0x1862e30?, 0xc000500e80?}, {0x18985f8?, 0xc0002ccb40?}})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150 +0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00023c000, {0x1870218?, 0xc0005c7cb0?}, 0xc0001f8870)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408 +0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x1870218?, 0xc0005c7cb0?}, 0xc0005ce298?)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195 +0x7a
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213 +0xf1d
2023/05/24 22:28:50 Job state: FAILED
2023/05/24 22:28:50 Failed to execute job: job load0tests0go0flink0batch0cogbk0200524215352-root-0524222732-33fe86ee_cce90f48-63af-40a4-8586-2b2a95edc3d6 failed
panic: Failed to execute job: job load0tests0go0flink0batch0cogbk0200524215352-root-0524222732-33fe86ee_cce90f48-63af-40a4-8586-2b2a95edc3d6 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18701a8, 0xc000126000}, {0x16edef8?, 0x237f290?}, {0xc000519e60?, 0x0?, 0x3e8?})
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/pkg/beam/log/log.go>:162 +0x8c
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:103 +0x4bb

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Flink_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 2m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/6o3u7xyymps64

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org