You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/08/16 17:07:00 UTC
[jira] [Commented] (BEAM-10266) Pipeline proto seems to be
incorrect for Combine.GroupedValues
[ https://issues.apache.org/jira/browse/BEAM-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178544#comment-17178544 ]
Beam JIRA Bot commented on BEAM-10266:
--------------------------------------
This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3.
Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean.
> Pipeline proto seems to be incorrect for Combine.GroupedValues
> --------------------------------------------------------------
>
> Key: BEAM-10266
> URL: https://issues.apache.org/jira/browse/BEAM-10266
> Project: Beam
> Issue Type: Sub-task
> Components: runner-dataflow, sdk-java-core
> Reporter: Luke Cwik
> Priority: P2
> Labels: portability, stale-P2
>
> It looks like CombineTest$BasicTests#testHotKeyCombining on Dataflow (and possibly other runners) is creating an invalid pipeline proto since the transform doesn't an environment (and possible a spec):
> {noformat}
> I0610 16:05:23.791430 14054 fnapi_instruction_graph_rewriter.cc:230] transforms {
> I0610 16:05:23.791402 14054 fnapi_instruction_graph_rewriter.cc:230] key: "HotMean/PostCombine/Combine.GroupedValues"
> I0610 16:05:23.791404 14054 fnapi_instruction_graph_rewriter.cc:230] value {
> I0610 16:05:23.791406 14054 fnapi_instruction_graph_rewriter.cc:230] inputs {
> I0610 16:05:23.791408 14054 fnapi_instruction_graph_rewriter.cc:230] key: "org.apache.beam.sdk.values.PCollection.<init>:400#56b99bb29b40d50c"
> I0610 16:05:23.791410 14054 fnapi_instruction_graph_rewriter.cc:230] value: "HotMean/PostCombine/GroupByKey.out"
> I0610 16:05:23.791412 14054 fnapi_instruction_graph_rewriter.cc:230] }
> I0610 16:05:23.791414 14054 fnapi_instruction_graph_rewriter.cc:230] outputs {
> I0610 16:05:23.791416 14054 fnapi_instruction_graph_rewriter.cc:230] key: "org.apache.beam.sdk.values.PCollection.<init>:400#4fa4d31096ca160c"
> I0610 16:05:23.791419 14054 fnapi_instruction_graph_rewriter.cc:230] value: "HotMean/PostCombine/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output"
> I0610 16:05:23.791421 14054 fnapi_instruction_graph_rewriter.cc:230] }
> I0610 16:05:23.791423 14054 fnapi_instruction_graph_rewriter.cc:230] unique_name: "HotMean/PostCombine/Combine.GroupedValues"
> I0610 16:05:23.791426 14054 fnapi_instruction_graph_rewriter.cc:230] }
> I0610 16:05:23.791428 14054 fnapi_instruction_graph_rewriter.cc:230] }{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)