You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 19:23:11 UTC
[GitHub] [beam] kennknowles opened a new issue, #18585: Pipeline proto seems to be incorrect for Combine.GroupedValues
kennknowles opened a new issue, #18585:
URL: https://github.com/apache/beam/issues/18585
It looks like CombineTest$BasicTests#testHotKeyCombining on Dataflow (and possibly other runners) is creating an invalid pipeline proto since the transform doesn't an environment (and possible a spec):
```
I0610 16:05:23.791430 14054 fnapi_instruction_graph_rewriter.cc:230] transforms {
I0610 16:05:23.791402
14054 fnapi_instruction_graph_rewriter.cc:230] key: "HotMean/PostCombine/Combine.GroupedValues"
I0610
16:05:23.791404 14054 fnapi_instruction_graph_rewriter.cc:230] value {
I0610 16:05:23.791406
14054 fnapi_instruction_graph_rewriter.cc:230] inputs {
I0610 16:05:23.791408 14054 fnapi_instruction_graph_rewriter.cc:230]
key: "org.apache.beam.sdk.values.PCollection.<init>:400#56b99bb29b40d50c"
I0610 16:05:23.791410
14054 fnapi_instruction_graph_rewriter.cc:230] value: "HotMean/PostCombine/GroupByKey.out"
I0610
16:05:23.791412 14054 fnapi_instruction_graph_rewriter.cc:230] }
I0610 16:05:23.791414 14054
fnapi_instruction_graph_rewriter.cc:230] outputs {
I0610 16:05:23.791416 14054 fnapi_instruction_graph_rewriter.cc:230]
key: "org.apache.beam.sdk.values.PCollection.<init>:400#4fa4d31096ca160c"
I0610 16:05:23.791419
14054 fnapi_instruction_graph_rewriter.cc:230] value: "HotMean/PostCombine/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output"
I0610
16:05:23.791421 14054 fnapi_instruction_graph_rewriter.cc:230] }
I0610 16:05:23.791423 14054
fnapi_instruction_graph_rewriter.cc:230] unique_name: "HotMean/PostCombine/Combine.GroupedValues"
I0610
16:05:23.791426 14054 fnapi_instruction_graph_rewriter.cc:230] }
I0610 16:05:23.791428 14054
fnapi_instruction_graph_rewriter.cc:230] }
```
Imported from Jira [BEAM-10266](https://issues.apache.org/jira/browse/BEAM-10266). Original Jira may contain additional context.
Reported by: lcwik.
Subtask of issue #18583
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org