You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "abhioncbr (via GitHub)" <gi...@apache.org> on 2023/12/15 01:36:01 UTC
[I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
abhioncbr opened a new issue, #12155:
URL: https://github.com/apache/pinot/issues/12155
[Redpanda](https://github.com/redpanda-data/redpanda) is a Kafka-compatible streaming data platform. This issue starts the community discussion around supporting Redpanda for streaming data into Pinot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "abhioncbr (via GitHub)" <gi...@apache.org>.
abhioncbr commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-1859007718
> Its already support redpanda. Recently, I setup pinot with redpanda
Thanks for mentioning. Since Readpanda is Kafka API compatible, it would be working.
question, did you set property `streamType` as `Kafka`? Can you please share a sample config?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "abhioncbr (via GitHub)" <gi...@apache.org>.
abhioncbr commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-2032518517
@dttung2905 you can work on this. Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "abhioncbr (via GitHub)" <gi...@apache.org>.
abhioncbr commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-1861998701
@Jackie-Jiang / @xiangfu0, is it okay to follow the same config as Kafka or change something related to Redpanda, like `streamType` as `RedPanda`.
Also do we want to add the test cases and integration tests related to RedPanda like we are doing for Pulsar or Kinesis?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "abhioncbr (via GitHub)" <gi...@apache.org>.
abhioncbr commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-1867991924
@Jackie-Jiang, please assign this to me. I will work on this. Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "EvgenyAfanasev (via GitHub)" <gi...@apache.org>.
EvgenyAfanasev commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-1859076847
all configs for kafka are same for redpanda.
[Here}(https://redpanda.com/blog/streaming-data-apache-pinot-kafka-connect-redpanda) you can find details
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-1862024619
Seems like RedPanda is Kafka compatible, so I'd suggest keeping it simple and just follow the same configs. +1 on adding an integration test on RedPanda if it doesn't pull in too many dependencies.
@kelseiv Should we add some documentation for RedPanda?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "dttung2905 (via GitHub)" <gi...@apache.org>.
dttung2905 commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-2030516261
Hi @abhioncbr, are you still working on this ? If not I can give it a try too
@Jackie-Jiang my simple understanding on this is we just have to add some documentations on this as Redpanda uses the same Kafka protocol, similar to this doc https://docs.pinot.apache.org/basics/data-import/pinot-stream-ingestion/import-from-apache-kafka :thinking: ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "EvgenyAfanasev (via GitHub)" <gi...@apache.org>.
EvgenyAfanasev commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-1858872580
Its already support redpanda. Recently, I setup pinot with redpanda
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Streaming data ingestion support in Pinot for Redpanda. [pinot]
Posted by "dttung2905 (via GitHub)" <gi...@apache.org>.
dttung2905 commented on issue #12155:
URL: https://github.com/apache/pinot/issues/12155#issuecomment-2035675993
Thanks @abhioncbr . I will work on this during this weekend
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org