You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Anu Engineer (Jira)" <ji...@apache.org> on 2019/12/05 17:21:00 UTC
[jira] [Updated] (HDDS-2653) Improve executor memory usage in new
Freon tests
[ https://issues.apache.org/jira/browse/HDDS-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anu Engineer updated HDDS-2653:
-------------------------------
Fix Version/s: 0.5.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
[~xyao] Thanks for the commit. [~adoroszlai] Thank you for the contribution.
> Improve executor memory usage in new Freon tests
> ------------------------------------------------
>
> Key: HDDS-2653
> URL: https://issues.apache.org/jira/browse/HDDS-2653
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Components: freon
> Affects Versions: 0.5.0
> Reporter: Attila Doroszlai
> Assignee: Attila Doroszlai
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.5.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> New Freon tests (descendants of {{BaseFreonGenerator}}) suffer from a similar memory issue due to concurrency handling as HDDS-1785.
> Steps to reproduce:
> {code}
> export HADOOP_OPTS='-Xmx256M -XX:+HeapDumpOnOutOfMemoryError'
> ozone freon omkg -F ONE -n 33554432 -t 10 -p omkg
> {code}
> Freon attempts to submit 32M tasks to the executor, requiring at least 1.5GB memory.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org