You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 23:38:16 UTC
[GitHub] [beam] damccorm opened a new issue, #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
damccorm opened a new issue, #21478:
URL: https://github.com/apache/beam/issues/21478
KafkaIO.Read().withDynamicRead() is correctly pulling messages from existing topics, but isn't picking up new topics or partitions when they are created.
Currently, this appears to be an interaction between the timer configuration, and the duration of the operating window, that is causing the problem
Imported from Jira [BEAM-13852](https://issues.apache.org/jira/browse/BEAM-13852). Original Jira may contain additional context.
Reported by: johnjcasey.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] johnjcasey commented on issue #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
Posted by GitBox <gi...@apache.org>.
johnjcasey commented on issue #21478:
URL: https://github.com/apache/beam/issues/21478#issuecomment-1147421307
@damccorm How can I assign myself to this and then close it? I'm logged in, but I'm not seeing those options
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] johnjcasey commented on issue #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
Posted by GitBox <gi...@apache.org>.
johnjcasey commented on issue #21478:
URL: https://github.com/apache/beam/issues/21478#issuecomment-1149947988
Unfortunately, I don't believe this ever worked. I'm working on it now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] jossonpaul commented on issue #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
Posted by GitBox <gi...@apache.org>.
jossonpaul commented on issue #21478:
URL: https://github.com/apache/beam/issues/21478#issuecomment-1149410973
@johnjcasey We are trying to use this feature. Please let me know the previous beam version this feature was working properly if at all it was working?.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21478:
URL: https://github.com/apache/beam/issues/21478#issuecomment-1146703331
Unable to assign user @johnjcasey. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] johnjcasey commented on issue #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
Posted by GitBox <gi...@apache.org>.
johnjcasey commented on issue #21478:
URL: https://github.com/apache/beam/issues/21478#issuecomment-1147519993
@damccorm please assign this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pabloem closed issue #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
Posted by GitBox <gi...@apache.org>.
pabloem closed issue #21478: KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions
URL: https://github.com/apache/beam/issues/21478
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org