[GitHub] [druid] jihoonson commented on issue #9343: [Proposal] Pubsub Indexing Service

[GitBox <gi...@apache.org>]

jihoonson commented on issue #9343: [Proposal] Pubsub Indexing Service
URL: https://github.com/apache/druid/issues/9343#issuecomment-585012920
 
 
   Hi @aditya-r-m, thank you for the proposal!
   
   > The proposed extension will work in a manner very similar to Seekable Stream Supervisors & Tasks that we currently have & will be a simplified version of the same in most cases.
   
   I think this explanation is quite vague and I'm not sure how the Pubsub indexing service would work especially with the different architecture of Pub/Sub from Kafka/Kinesis. Would you please add more details including the below?
   
   - What semantics is guaranteed by the proposed indexing service? I don't think the exactly-once ingestion is possible. And how does the proposed indexing service guarantee it?
   - Description on the overall algorithm including what the supervisor and its tasks do, respectively.
   - Does the proposed indexing service provide linear scalability? If so, how does it provide?
   - How does it handle transient failures such as task failures?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org