You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "James Matthews (Jira)" <ji...@apache.org> on 2021/05/17 20:30:00 UTC
[jira] [Commented] (BEAM-12158) "v1.proto" is already registered
error for golang dataflow
[ https://issues.apache.org/jira/browse/BEAM-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346421#comment-17346421 ]
James Matthews commented on BEAM-12158:
---------------------------------------
Hi - I'm still seeing this same failure at current master. minimal_wordcount works, but wordcount doesn't; that implies that the problem is with go/pkg/beam/x/beamx, since that's the only import in wordcount but not in minimal_wordcount.
{code:java}
> go version
go version go1.16.3 darwin/amd64
> go install github.com/apache/beam/sdks/go/examples/wordcount@master
go: downloading github.com/apache/beam v2.2.1-0.20210517172658-dd2f67bb8ec4+incompatible
[...]
>wordcount
panic: proto: file "v1.proto" is already registeredpanic: proto: file "v1.proto" is already registeredSee https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict
goroutine 1 [running]:
google.golang.org/protobuf/reflect/protoregistry.glob..func1(0x1d5eb78, 0xc000418700, 0x1d44fe0, 0xc0002e7150, 0xc000418700)
$HOME/go/pkg/mod/google.golang.org/protobuf@v1.26.0/reflect/protoregistry/registry.go:54 +0x25f
google.golang.org/protobuf/reflect/protoregistry.(*Files).RegisterFile(0xc000190550, 0x1d61ba8, 0xc000418700, 0x0, 0x0)
$HOME/go/pkg/mod/google.golang.org/protobuf@v1.26.0/reflect/protoregistry/registry.go:127 +0xbb8
google.golang.org/protobuf/internal/filedesc.Builder.Build(0x0, 0x0, 0xc000432600, 0x12a, 0x200, 0x100000001, 0x0, 0x1d4ba18, 0xc000194450, 0x1d53ff0, ...)
$HOME/go/pkg/mod/google.golang.org/protobuf@v1.26.0/internal/filedesc/build.go:113 +0x1aa
github.com/golang/protobuf/proto.RegisterFile(0x1c352cd, 0x8, 0x233dda0, 0xe2, 0xe2)
$HOME/go/pkg/mod/github.com/golang/protobuf@v1.5.2/proto/registry.go:48 +0x148
github.com/apache/beam/sdks/go/pkg/beam/io/pubsubio/v1.init.1()
$HOME/go/pkg/mod/github.com/apache/beam@v2.2.1-0.20210517172658-dd2f67bb8ec4+incompatible/sdks/go/pkg/beam/io/pubsubio/v1/v1.pb.go:115 +0x5a
{code}
> "v1.proto" is already registered error for golang dataflow
> ----------------------------------------------------------
>
> Key: BEAM-12158
> URL: https://issues.apache.org/jira/browse/BEAM-12158
> Project: Beam
> Issue Type: Bug
> Components: sdk-go
> Reporter: Kazuki Nishiura
> Assignee: Robert Burke
> Priority: P2
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> I tried to run wordcount example in go [https://beam.apache.org/get-started/quickstart-go/]
> It worked fine in dev but when I try to run it on GCP dataflow, I got '"v1.proto" is already registered' error and job crashes.
>
> It seems proto definition here is using very generic package name "v1" which I suspect is a cause of issue
> https://github.com/apache/beam/blob/v2.28.0/sdks/go/pkg/beam/io/pubsubio/v1/v1.proto
>
> Here is log in GCP
> {code:java}
> "panic: proto: file "v1.proto" is already registered "
> "See https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict "
> "goroutine 1 [running]: "
> "google.golang.org/protobuf/reflect/protoregistry.glob..func1(0x1683000, 0xc0005201c0, 0x164a080, 0xc0004657e0, 0xc0005201c0) "
> " /Users/kazuki/go/pkg/mod/google.golang.org/protobuf@v1.26.0/reflect/protoregistry/registry.go:54 +0x24c "
> "google.golang.org/protobuf/reflect/protoregistry.(*Files).RegisterFile(0xc000068350, 0x1688e40, 0xc0005201c0, 0x0, 0x0) "
> " /Users/kazuki/go/pkg/mod/google.golang.org/protobuf@v1.26.0/reflect/protoregistry/registry.go:127 +0xb6c "
> "google.golang.org/protobuf/internal/filedesc.Builder.Build(0x0, 0x0, 0xc000361e00, 0x12a, 0x200, 0x100000001, 0x0, 0x1654b00, 0xc00003c330, 0x1665e40, ...) "
> " /Users/kazuki/go/pkg/mod/google.golang.org/protobuf@v1.26.0/internal/filedesc/build.go:113 +0x195 "
> "github.com/golang/protobuf/proto.RegisterFile(0x148e167, 0x8, 0x1fdc7a0, 0xe2, 0xe2) "
> " /Users/kazuki/go/pkg/mod/github.com/golang/protobuf@v1.5.2/proto/registry.go:48 +0x13b "
> "github.com/apache/beam/sdks/go/pkg/beam/io/pubsubio/v1.init.1() "
> " /Users/kazuki/go/pkg/mod/github.com/apache/beam@v2.28.0+incompatible/sdks/go/pkg/beam/io/pubsubio/v1/v1.pb.go:115 +0x5a "
> "2021/04/12 19:32:22 User program exited: exit status 2 "
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)