You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 18:22:02 UTC
[GitHub] [beam] damccorm opened a new issue, #20637: Can't use side inputs with Combine.PerKeyWithHotKeyFanout
damccorm opened a new issue, #20637:
URL: https://github.com/apache/beam/issues/20637
PerKeyWithHotKeyFanout doesn't allow a user to specify a side input and access it in the CombineFn. When the function `withHotKeyFanout` is called, any sideinputs stored in the Combine.PerKey are dropped. ([https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Combine.java#L1571](https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Combine.java#L1571)):
```
public PerKeyWithHotKeyFanout<K, InputT, OutputT> withHotKeyFanout(
SerializableFunction<?
super K, Integer> hotKeyFanout) {
return new PerKeyWithHotKeyFanout<>(fn, fnDisplayData, hotKeyFanout);
}
```
We would like to be able to use side inputs and hot key fanout.
Imported from Jira [BEAM-11005](https://issues.apache.org/jira/browse/BEAM-11005). Original Jira may contain additional context.
Reported by: miagilepner.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #20637: Can't use side inputs with Combine.PerKeyWithHotKeyFanout
Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm commented on issue #20637:
URL: https://github.com/apache/beam/issues/20637#issuecomment-1547890862
Hey, saw you added this comment several places. I'd recommend focusing on a single issue at first (I answered the underlying question here - https://github.com/apache/beam/issues/20298#issuecomment-1547888993)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] blazingbhavneek commented on issue #20637: Can't use side inputs with Combine.PerKeyWithHotKeyFanout
Posted by "blazingbhavneek (via GitHub)" <gi...@apache.org>.
blazingbhavneek commented on issue #20637:
URL: https://github.com/apache/beam/issues/20637#issuecomment-1546160550
Hey there! 👋 I'm new to this repository and eager to contribute! 🌟 Could you kindly suggest some entry point or files to look into?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Can't use side inputs with Combine.PerKeyWithHotKeyFanout [beam]
Posted by "marc7806 (via GitHub)" <gi...@apache.org>.
marc7806 commented on issue #20637:
URL: https://github.com/apache/beam/issues/20637#issuecomment-1750064914
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org