You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2022/10/13 12:24:08 UTC

[GitHub] [druid] cryptoe opened a new issue, #13222: Support topicPattern's in kafka ingestion.

cryptoe opened a new issue, #13222:
URL: https://github.com/apache/druid/issues/13222

   ### Description
   It's about time we support topic patterns in Kafka ingestion. This will enable us to ingest data from multiple topics into a single data source. 
   
   ### Motivation
   A lot of companies have the same schema data, from different cluster regions, flowing into different topics with a pattern like topic_cluster_region. Currently, users do a union query over multiple data sources .
   
   Ideally, druid should be able to ingest data from multiple topics into a single data source so that users need not do union on the query side. 
   
   Also, I see a lot of people on the druid slack channel requesting this issue. 
   
   https://github.com/apache/druid/pull/2656#issuecomment-215328237
   This work was also planned as part of the initial Kafka ingestion PR. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Support topicPattern's in kafka ingestion. (druid)

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #13222:
URL: https://github.com/apache/druid/issues/13222#issuecomment-1885969263

   This issue has been marked as stale due to 280 days of inactivity.
   It will be closed in 4 weeks if no further activity occurs. If this issue is still
   relevant, please simply write any comment. Even if closed, you can still revive the
   issue at any time or discuss it on the dev@druid.apache.org list.
   Thank you for your contributions.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Support topicPattern's in kafka ingestion. (druid)

Posted by "cryptoe (via GitHub)" <gi...@apache.org>.
cryptoe commented on issue #13222:
URL: https://github.com/apache/druid/issues/13222#issuecomment-1886646164

   Closed via https://github.com/apache/druid/pull/14424


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Support topicPattern's in kafka ingestion. (druid)

Posted by "cryptoe (via GitHub)" <gi...@apache.org>.
cryptoe closed issue #13222: Support topicPattern's in kafka ingestion. 
URL: https://github.com/apache/druid/issues/13222


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org