You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Madhusanka Jayalath (Jira)" <ji...@apache.org> on 2020/04/24 01:10:00 UTC
[jira] [Commented] (BEAM-9459) Go Postcommit failing at GBK
[ https://issues.apache.org/jira/browse/BEAM-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091069#comment-17091069 ]
Chamikara Madhusanka Jayalath commented on BEAM-9459:
-----------------------------------------------------
Seems like a number of test failing in Go PostCommit now.
[https://builds.apache.org/job/beam_PostCommit_Go/6839/console#gradle-task-0]
*15:24* 2020/04/23 23:15:24 Test wordcount:memfs failed: job 2020-04-23_15_13_17-1465226616742493284 failed*16:15:24* 2020/04/23 23:15:24 Test pardo:sideinput failed: job 2020-04-23_15_13_17-759362908912584747 failed*16:15:24* 2020/04/23 23:15:24 Test wordcount:kinglear failed: job 2020-04-23_15_13_17-1125837944538922899 failed*16:15:25* 2020/04/23 23:15:25 Test pardo:kvsideinput failed: job 2020-04-23_15_13_18-17784720028944521419 failed*16:15:25* 2020/04/23 23:15:25 Test reshuffle:reshufflekv failed: job 2020-04-23_15_13_18-14065871254969247116 failed*16:15:25* 2020/04/23 23:15:25 Test pardo:multioutput failed: job 2020-04-23_15_13_18-10256228854737713336 failed*16:15:25* 2020/04/23 23:15:25 Test flatten:flatten failed: job 2020-04-23_15_13_18-158411452554482119 failed*16:15:26* 2020/04/23 23:15:26 Test cogbk:cogbk failed: job 2020-04-23_15_13_18-15020222269196287377 failed*16:15:27* 2020/04/23 23:15:27 Test reshuffle:reshuffle failed: job 2020-04-23_15_13_18-5418434657358800557 failed
Are these related or do we need new issues ?
> Go Postcommit failing at GBK
> ----------------------------
>
> Key: BEAM-9459
> URL: https://issues.apache.org/jira/browse/BEAM-9459
> Project: Beam
> Issue Type: Bug
> Components: sdk-go, test-failures
> Reporter: Daniel Oliveira
> Assignee: Robert Burke
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Example: [https://builds.apache.org/job/beam_PostCommit_Go_PR/106/]
> [https://scans.gradle.com/s/es67rfaomu26m]
>
> {noformat}
> 2020/03/06 00:47:41 Submitted job: 2020-03-05_16_47_40-13139296997856231782
> 2020/03/06 00:47:41 Submitted job: 2020-03-05_16_47_40-13139296997856231782
> 2020/03/06 00:47:41 Console: https://console.cloud.google.com/dataflow/job/2020-03-05_16_47_40-13139296997856231782?project=apache-beam-testing
> 2020/03/06 00:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2020-03-05_16_47_40-13139296997856231782
> ...
> 2020/03/06 00:50:41 Test cogbk:cogbk failed: job 2020-03-05_16_47_40-13139296997856231782 failed{noformat}
> And then in the console logs: [https://pantheon.corp.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2020-03-05_16_47_40-13139296997856231782&minLogLevel=500&expandAll=false×tamp=2020-03-06T01:01:14.210000000Z&customFacets=&limitCustomFacetWidth=true&dateRangeStart=2020-03-06T00:01:14.460Z&dateRangeEnd=2020-03-06T01:01:14.460Z&interval=PT1H&scrollTimestamp=2020-03-06T00:49:14.413355915Z]
>
> {code:java}
> exception: "java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error received from SDK harness for instruction -165: process bundle failed for instruction -165 using plan -122 : panic: Unexpected coder: CoGBK<string[string],int[varintz],int[varintz],string[string]> goroutine 81 [running]:
> runtime/debug.Stack(0xc001103970, 0xd2c5e0, 0xc000bd7f40)
> /usr/lib/go-1.12/src/runtime/debug/stack.go:24 +0x9d
> github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic.func1(0xc001103b90)
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/util.go:40 +0x60
> panic(0xd2c5e0, 0xc000bd7f40)
> /usr/lib/go-1.12/src/runtime/panic.go:522 +0x1b5
> github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.MakeElementEncoder(0xc000b99cc0, 0xc000aa4930, 0xc000b64a00)
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/coder.go:91 +0x479
> github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*PCollection).Up(0xc000af3dd0, 0x10018e0, 0xc000b57f80, 0x0, 0xc000346b50)
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/pcollection.go:59 +0xfe
> github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.callNoPanic(0x10018e0, 0xc000b57f80, 0xc000346c28, 0x0, 0x0)
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/util.go:43 +0x6c
> github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0002623f0, 0x10018e0, 0xc000b57f80, 0xc0002365a0, 0x4, 0xff0340, 0xc000aa4750, 0xff0380, 0xc000b57fc0, 0xc000346de0, ...)
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/plan.go:93 +0xdf
> github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0001f4680, 0x10017a0, 0xc0001bafc0, 0xc000b57dc0, 0xc0001bafc0)
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:211 +0xa34
> github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main.func2(0x10017a0, 0xc0001bafc0, 0xc000b57dc0)
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:118 +0x1cf
> created by github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_PR/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:131 +0x6e8
> at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
> at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:57)
> at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.finish(RegisterAndProcessBundleOperation.java:332)
> at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:85)
> at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:125)
> at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:412)
> at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:381)
> at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:306)
> at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:230)
> at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:138)
> Suppressed: java.lang.IllegalStateException: Already closed.
> at org.apache.beam.sdk.fn.data.BeamFnDataSizeBasedBufferingOutboundObserver.close(BeamFnDataSizeBasedBufferingOutboundObserver.java:67)
> at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:220)
> at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:91)
> ... 6 more
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)