You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/05 00:30:22 UTC
[GitHub] [beam] damccorm opened a new issue, #21606: Python sdk's PeriodicImpulse generates a bounded PCollection
damccorm opened a new issue, #21606:
URL: https://github.com/apache/beam/issues/21606
See the dev mail list thread for details: https://lists.apache.org/thread/ps3m0jc0ngqp1y2s0mv2n6hxhvgkr3vw
PeriodicImpluse transform in Java sdk generates unbounded
PCollection; while in Python sdk it generates bounded PCollection. The
latter case may cause issues in streaming.
Per Cham: Note that the primary use-case of PeriodicImpulse (according to the design doc) was to
generate a fixed/bounded input that can slowly change over time but
changing over time dimension would make it unbounded.
Seems like we need to make python PeriodicImpulse generates an unbounded pcoll, in alignment with Java implementation, and also make sure that the change does not break the current implementation of its original use case (stream enrichment problem).
Imported from Jira [BEAM-14498](https://issues.apache.org/jira/browse/BEAM-14498). Original Jira may contain additional context.
Reported by: yihu.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21606: Python sdk's PeriodicImpulse generates a bounded PCollection
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21606:
URL: https://github.com/apache/beam/issues/21606#issuecomment-1155247691
It is a clear bug, but I don't think we need to block the release on this do we?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #21606: Python sdk's PeriodicImpulse generates a bounded PCollection
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #21606:
URL: https://github.com/apache/beam/issues/21606#issuecomment-1152972135
For more context, see https://lists.apache.org/thread/ps3m0jc0ngqp1y2s0mv2n6hxhvgkr3vw
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] lostluck closed issue #21606: Python sdk's PeriodicImpulse generates a bounded PCollection
Posted by GitBox <gi...@apache.org>.
lostluck closed issue #21606: Python sdk's PeriodicImpulse generates a bounded PCollection
URL: https://github.com/apache/beam/issues/21606
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org