[GitHub] [incubator-pinot] Eywek commented on issue #6302: [pinot]Support for pausing the realtime consumption without disabling the table.

[GitBox <gi...@apache.org>]

Eywek commented on issue #6302:
URL: https://github.com/apache/incubator-pinot/issues/6302#issuecomment-795668118


   > Question for the community: Are there others who need this feature?
   
   👋  yes. We're planning to use Pinot to store some data from our users. We currently pull data from some APIs for our customers, transform it and store it. As this data can be quite large it means we need to stream it, and we need to be able to push this transformed data as a stream into pulsar. To do this we plan to use a REALTIME table because we don't want to use Batch ingestion as it means that we need rely on a s3 bucket and we won't be able to know when the data is available for queries. 
   But when we've finished to pull data from those APIs, we won't update the table anymore, so being able to stop the ingestion but keep the query available could be really useful to avoid putting useless pressure on our Apache Pulsar (we using [KoP](https://github.com/streamnative/kop) to be able to use Kafka ingestion plugin).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org