You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/05/07 04:56:35 UTC

[GitHub] [druid] averma111 opened a new issue #9835: Spark built in connector for Druid

averma111 opened a new issue #9835:
URL: https://github.com/apache/druid/issues/9835


   ### Motivation
   In my current project there is a requirement to load HDFS data combined with Db2 data which is huge in number. The data volume is almost 1 TB per day. We need to join these two huge data sets and the perform business logic on top if to create daily report for insights.
   
   ### Proposed changes
   Today we need to use Tranquilizer Beam, storm or any other middle ware  with spark to push the data into Druid. If we have spark connector directly connection we can all the transformation directly into spark push it like we have kafka indexing services.
   
   I am not very professional in Java tech stack but learning , hopefully if no is working on this proposal one day I will create it.:)
   
   Thanks,
   Ashish


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org

[GitHub] [druid] mangrrua commented on issue #9835: Spark built in connector for Druid

Posted by GitBox <gi...@apache.org>.
mangrrua commented on issue #9835:
URL: https://github.com/apache/druid/issues/9835#issuecomment-677875718


   Check issue #9780 for batch read/write operation 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org