You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 15:26:40 UTC
[GitHub] [beam] damccorm opened a new issue, #17947: Refine specification for WindowFn.isCompatible()
damccorm opened a new issue, #17947:
URL: https://github.com/apache/beam/issues/17947
`WindowFn#isCompatible` doesn't really have a spec. In practice, it is used primarily when flattening together multiple PCollections. All of the WindowFns must be compatible, and then just a single WindowFn is selected arbitrarily for the output PCollection.
In consequence, downstream of the Flatten, the merging behavior will be taken from this WindowFn.
Currently, there are some mismatches:
- Sessions with different gap durations _are_ compatible today, but probably shouldn't be since merging makes little sense. (The use of tiny proto-windows is an implementation detail anyhow)
- SlidingWindows and FixedWindows _could_ reasonably be compatible if they had the same duration, though it might be odd.
Either way, we should just nail down what we actually mean so we can arrive at a verdict in these cases.
Imported from Jira [BEAM-653](https://issues.apache.org/jira/browse/BEAM-653). Original Jira may contain additional context.
Reported by: kenn.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm closed issue #17947: Refine specification for WindowFn.isCompatible()
Posted by GitBox <gi...@apache.org>.
damccorm closed issue #17947: Refine specification for WindowFn.isCompatible()
URL: https://github.com/apache/beam/issues/17947
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org