[GitHub] [iceberg] RussellSpitzer commented on issue #3885: [OOM] MERGE INTO table with Spark Structured Streaming

[GitBox <gi...@apache.org>]

RussellSpitzer commented on issue #3885:
URL: https://github.com/apache/iceberg/issues/3885#issuecomment-1012319398


   OOM's can happen for a lot of reasons, did you see a memory leak? Or monotonically increasing heap size? I would make sure it isn't one particular merge causing the issue before diagnosing. 
   
   The Error there looks like an Operating System kill, so it's not explicitly a JVM thing either. It could just be that the container is too small for the heap + offheap usage configured in spark.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org