You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Ethan Li (JIRA)" <ji...@apache.org> on 2019/07/26 14:22:00 UTC
[jira] [Comment Edited] (STORM-3403) Incorrect Assigned memory
displayed on Storm UI
[ https://issues.apache.org/jira/browse/STORM-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893855#comment-16893855 ]
Ethan Li edited comment on STORM-3403 at 7/26/19 2:21 PM:
----------------------------------------------------------
Please don't -Xmx in "topology.worker.childopts" directly.
https://github.com/apache/storm/blob/v1.2.2/storm-core/src/jvm/org/apache/storm/Config.java#L1919
https://github.com/apache/storm/blob/v1.2.2/storm-core/src/jvm/org/apache/storm/Config.java#L1477
" %HEAP-MEM%" in "worker.childopts" will be replaced with the onheap memory settings.
Refer to
https://github.com/apache/storm/blob/v1.2.2/storm-core/src/jvm/org/apache/storm/daemon/supervisor/BasicContainer.java#L658-L660
https://github.com/apache/storm/blob/v1.2.2/storm-core/src/jvm/org/apache/storm/daemon/supervisor/BasicContainer.java#L690
https://github.com/apache/storm/blob/v1.2.2/storm-core/src/jvm/org/apache/storm/daemon/supervisor/BasicContainer.java#L585
was (Author: ethanli):
Please don't -Xmx in "topology.worker.childopts" directly.
https://github.com/apache/storm/blob/v1.2.2/storm-core/src/jvm/org/apache/storm/Config.java#L1919
https://github.com/apache/storm/blob/v1.2.2/storm-core/src/jvm/org/apache/storm/Config.java#L1477
" %HEAP-MEM%" in "worker.childopts" will be replaced with the onheap memory settings.
> Incorrect Assigned memory displayed on Storm UI
> -----------------------------------------------
>
> Key: STORM-3403
> URL: https://issues.apache.org/jira/browse/STORM-3403
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-ui
> Affects Versions: 1.2.2
> Reporter: Nikhil
> Priority: Major
> Attachments: componentsScreenshot.png, topologyAssignedMem.png
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> Hi Team,
>
> We are working on storm upgrade from 1.0.2 to 1.2.2. During upgrade, we realised that assigned memory displayed on Storm UI is incorrect. Attached screenshot for more details.
>
> Looks like assigned memory is sum of memory provided in topology.worker.childopts and topology.worker.logwriter.childopts options.
>
> Multiple scenarios we have observed where assigned memory is not correct-
> # If topology.worker.childopts memory is more than 3 GB, in this case assigned memory is showing 65 MB.
> # If topology.worker.childopts memory+ topology.worker.logwriter.childopts memory is below 50 for last 2 digits.
> For eg.,
> topology.worker.childopts = 2048 MB
> topology.worker.logwriter.childopts = 64 MB
> Total = 2112 MB
> Here, last 2 digits are below 50, in this case assigned memory is showing 65 MB.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)