You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/07/31 13:01:15 UTC
[GitHub] [hudi] zherenyu831 opened a new issue #1892: [SUPPORT] Hudi compaction caused OOM problem
zherenyu831 opened a new issue #1892:
URL: https://github.com/apache/hudi/issues/1892
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)?
- Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
- If you have triaged this as a bug, then file an [issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
**Describe the problem you faced**
We are using 2 executors with 1G memory and 1G overheard memory to upsert data.
But we always got error on compaction, like below
```
00:18 WARN: [kryo] Unable to load class org.apache.hudi.common.model.OverwriteWithLatestAvroPayload$$Lambda$640/542767016 with kryo's ClassLoader. Retrying with current..
#
# java.lang.OutOfMemoryError: GC overhead limit exceeded
# -XX:OnOutOfMemoryError="kill %p"
# Executing /bin/sh -c "kill 25264"...
```
**To Reproduce**
Steps to reproduce the behavior:
1.
2.
3.
4.
**Expected behavior**
A clear and concise description of what you expected to happen.
**Environment Description**
* Hudi version : 0.5.3
* Spark version : 2.4.4
* Hive version : 3.1.2
* Hadoop version : 3.1.2
* Storage (HDFS/S3/GCS..) : S3
* Running on Docker? (yes/no) : NO
**Additional context**
Add any other context about the problem here.
**Stacktrace**
```Add the stacktrace of the error.```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zherenyu831 commented on issue #1892: [SUPPORT] Hudi compaction caused OOM problem
Posted by GitBox <gi...@apache.org>.
zherenyu831 commented on issue #1892:
URL: https://github.com/apache/hudi/issues/1892#issuecomment-668110539
@bvaradar
Although we use 4GB for executor, the OOM problem still happens
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zherenyu831 edited a comment on issue #1892: [SUPPORT] Hudi compaction caused OOM problem
Posted by GitBox <gi...@apache.org>.
zherenyu831 edited a comment on issue #1892:
URL: https://github.com/apache/hudi/issues/1892#issuecomment-668110539
@bvaradar
Thank you for advising, let me have try with that
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on issue #1892: [SUPPORT] Hudi compaction caused OOM problem
Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #1892:
URL: https://github.com/apache/hudi/issues/1892#issuecomment-668089941
@zherenyu831 : You would need to set HoodieMemoryConfig.MAX_MEMORY_FOR_COMPACTION_PROP The default is already 1GB which is your executor size.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zherenyu831 closed issue #1892: [SUPPORT] Hudi compaction caused OOM problem
Posted by GitBox <gi...@apache.org>.
zherenyu831 closed issue #1892:
URL: https://github.com/apache/hudi/issues/1892
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org