You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Roshan Naik (JIRA)" <ji...@apache.org> on 2017/12/28 10:12:00 UTC
[jira] [Updated] (STORM-2871) Performance optimizations for
getOutgoingTasks
[ https://issues.apache.org/jira/browse/STORM-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roshan Naik updated STORM-2871:
-------------------------------
Description:
Task.getOutgoingTasks() is in critical messaging path. Two observed bottlenecks in it :
- [Looking up HashMap|] 'streamToGroupers'. Need to look into converting HashMap into Array lookup ?
- [outTasks.addAll(compTasks)|https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/daemon/Task.java#L139] seems to be impacting throughput as well. Identified by .. running ConstSpoutNullBoltTopo with 1 spout & bolt paralllelism (no Ack) and replacing this line with hard coded logic to add the single known bolt's taskID.
was:
Task.getOutgoingTasks() is in critical messaging path. Two observed bottlenecks in it :
-[Looking up HashMap|] 'streamToGroupers'. Need to look into converting HashMap into Array lookup ?
- [outTasks.addAll(compTasks)|https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/daemon/Task.java#L139] seems to be impacting throughput as well. Identified by .. running ConstSpoutNullBoltTopo with 1 spout & bolt paralllelism (no Ack) and replacing this line with hard coded logic to add the single known bolt's taskID.
> Performance optimizations for getOutgoingTasks
> -----------------------------------------------
>
> Key: STORM-2871
> URL: https://issues.apache.org/jira/browse/STORM-2871
> Project: Apache Storm
> Issue Type: Improvement
> Reporter: Roshan Naik
>
> Task.getOutgoingTasks() is in critical messaging path. Two observed bottlenecks in it :
> - [Looking up HashMap|] 'streamToGroupers'. Need to look into converting HashMap into Array lookup ?
> - [outTasks.addAll(compTasks)|https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/daemon/Task.java#L139] seems to be impacting throughput as well. Identified by .. running ConstSpoutNullBoltTopo with 1 spout & bolt paralllelism (no Ack) and replacing this line with hard coded logic to add the single known bolt's taskID.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)