[jira] [Updated] (BEAM-11574) Enable x-lang on Dataflow side for integration tests

["Kenneth Knowles (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-11574:
-----------------------------------
    Status: Open  (was: Triage Needed)

> Enable x-lang on Dataflow side for integration tests
> ----------------------------------------------------
>
>                 Key: BEAM-11574
>                 URL: https://issues.apache.org/jira/browse/BEAM-11574
>             Project: Beam
>          Issue Type: Bug
>          Components: cross-language, sdk-go
>            Reporter: Daniel Oliveira
>            Assignee: Daniel Oliveira
>            Priority: P2
>
> Dataflow x-lang ValidatesRunner tests are failing with the following error:
> {noformat}
> 2021/01/05 21:57:59 Staged model pipeline: gs://clouddfe-danoliveira/temp-storage-go-end-to-end-tests/staging-validatesrunner-test/go-1-1609912673288691694/model
>     ptest.go:97: Failed to execute job: invalid Combine payload , missing Accumulator Coder unique_name:"PjLfVbFvtsExternal"  spec:{urn:"beam:transform:combine_per_key:v1"  payload:"\n\xe1\x01\n\x19beam:combinefn:javasdk:v1\x1a\xc3\x01\x82SNAPPY\x00\x00\x00\x00\x01\x00\x00\x00\x01\x00\x00\x00\xaf\x9c\x02\xf0C\xac\xed\x00\x05sr\x00,org.apache.beam.sdk.transforms.Sum$SumLongFn]\x12ܾ\"M\x80\xd5\x02\x00\x00xr\x00:ov;\x004Combine$Binary\r\x0e\x00L\x05I -\r\xda\x12\x13\r\x9b\xdd\x02\x05I\x000z\x84\x00\r;\x00$\r\x08$Fn\x1f4³>֧\x94\t?\x00D\x96?\x00PFnBase$AbstractGlobal\x15S0\xa6BY\xe0V\xebн\x02\x00\x00xp\x12\x17PjLfVbFvtsDelegateCoder"}  subtransforms:"PjLfVbFvtsExternal/GroupByKey"  subtransforms:"PjLfVbFvtsExternal/Combine.GroupedValues"  inputs:{key:"org.apache.beam.sdk.values.PCollection.<init>:402#bb20b45fd4d95138"  value:"n3"}  outputs:{key:"output"  value:"PjLfVbFvtsExternal/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output"}  display_data:{urn:"beam:display_data:labelled_string:v1"  payload:"\n\x08Combiner\x12,org.apache.beam.sdk.transforms.Sum$SumLongFn"}  environment_id:"PjLfVbFvtsbeam:env:docker:v1"
>                 caused by:
>                 unmarshalling coder PjLfVbFvtsDelegateCoder
>         could not unmarshal coder from spec:{urn:"beam:coders:javasdk:0.1"  payload:"\x82SNAPPY\x00\x00\x00\x00\x01\x00\x00\x00\x01\x00\x00\x01\x82\x96\x05\xf0>\xac\xed\x00\x05sr\x00(org.apache.beam.sdk.coders.DelegateCoder~\x10P\xea\xdbb4\xdc\x02\x00\x04L\x00\x05c\x01\" t\x00\"Lorg/a\x05?\x00/\x01?\x10/sdk/\t?\x00/\x0570;L\x00\x06fromFnt\x009n.\x002m\x00\xc0$CodingFunction;L\x00\x04toFnq\x00~\x00\x02L\x00\x0etypeDescriptort\x00+LN\x87\x00\x1cvalues/T2-\x00\x10;xr\x00&j\xf4\x00\x14Custom\x05\xbb8j\xb0\x08\x9d\x0b;\x1d\x0b\x02\x00\x00xr\x00 n5\x00!\x0e\x1cC\xddՉ\xae\xbc~\xf8\x01/\x10psr\x00'j1\x00\x18VarLong\x058\x1c\\l\xd6\xc3M\xfeMi\x018\x08r\x00*j6\x00$Structured\x059\x1cs\xbf\x12\x0e\xd5\xd46\x11\x019!\x1a!\xcf\x00QN?\x00`transforms.Combine$Binary\r\x0e\x01\x8b\x18Fn$From\x01\x0b\x00C2|\x01\x1c\x1f\xb1\x85\x04\x1a\xae\xc7J\x01f\x01\xd7\x00O\xeab\x00\x04ToF`\x004\xa1\x9f\xc1\xd98\xdc\x1d\xcb\x02\x00\x00xpp"}, unknown URN beam:coders:javasdk:0.1
> {noformat}
> This seems to imply that the bundles intended to be sent to the Java SDK are still being sent to the Go SDK (these are Go SDK errors), so it seems that cross-language functionality still needs to be enabled for the integration tests.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)