[GitHub] [incubator-pinot] MrNeocore opened a new issue #7022: User feedback on REALTIME table update for topic modification

[GitBox <gi...@apache.org>]

MrNeocore opened a new issue #7022:
URL: https://github.com/apache/incubator-pinot/issues/7022


   Following Slack discussion : https://apache-pinot.slack.com/archives/C011C9JHN7R/p1622809155406800
   
   Changing the topic a REALTIME table is consuming from is not possible as for now.
   -> `stream.kafka.topic.name`
   
   However, a table definition update is fully accepted without warnings.
   
   We should provide some user feedback regarding this limitation.
   
   1. In the docs: I'll open a PR.
   2. At the API level: We could either warn or fully reject the table update in such instances.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [incubator-pinot] mcvsubbu commented on issue #7022: User feedback on REALTIME table update for topic modification

[GitBox <gi...@apache.org>]

mcvsubbu commented on issue #7022:
URL: https://github.com/apache/incubator-pinot/issues/7022#issuecomment-854860935


   We had considered this before. The best way to do this seemed to be to introduce a new API call into streams, returning a boolean whether or not the new streams config is compatible with the old one. Each underlying stream would then have to implement the logic to scan through. In case of Kafka, change in topic, or change in broker address should not be permitted (at least for some implementations). Some implementations may allow change in broker address as long as the topic is the same.
   
   For Kinesis, appropriate checks need to be added.
   
   Thanks for filing the issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org