[GitHub] [incubator-druid] CalvinSchulze opened a new issue #8053: Kafka Ingestion Loop

[GitBox <gi...@apache.org>]

CalvinSchulze opened a new issue #8053: Kafka Ingestion Loop
URL: https://github.com/apache/incubator-druid/issues/8053
 
 
   ### Affected Version
   
   0.15.0 
   
   ### Description
   
   I'm running the micro quicktest and ingest data via supervisor task from Kafka. When I tried to push 100 million files into druid, the task crashed with an out of memory exception (GC overhead limit exceeded). Of course I need to upscale the JVM, but I was waiting for 3 days now for druid to catch up on this error. But instead it regularly starts new tasks, which load parts of the data I ingested. They crash again and the loaded data is gone again. This has been looping and probably will be looping forever.  All of these tasks are just running for about a minute.
   
   I'll not change any druid setting now and I won't delete the data. Feel free to ask for logs, if needed.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org