You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/10 04:20:00 UTC
[jira] [Commented] (STORM-3100) Minor optimization: Replace
HashMap with an array backed data structure for faster lookups
[ https://issues.apache.org/jira/browse/STORM-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16537969#comment-16537969 ]
Jungtaek Lim commented on STORM-3100:
-------------------------------------
I would remove epic link for this, since this is rather improvement, not blocker for Storm 2.0.0. There's still a chance for this to be included in Storm 2.0.0 but shouldn't explicitly mark as a blocker.
> Minor optimization: Replace HashMap<Integer, T> with an array backed data structure for faster lookups
> ------------------------------------------------------------------------------------------------------
>
> Key: STORM-3100
> URL: https://issues.apache.org/jira/browse/STORM-3100
> Project: Apache Storm
> Issue Type: Improvement
> Reporter: Roshan Naik
> Assignee: Roshan Naik
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> * Introduce _CustomIndexArray_: An array backed data structure to speedup HashMap<Integer, T> use cases *in critical path*. It needs to supported -ve indexing and a user defined (on construction) Upper and Lower Index range. Does not need to be dynamically resizable given the nature of use cases we have.
> * Use this data structure for _GeneralTopologyContext._taskToComponent_ mapping which is looked up in the critical path _Task.getOutgoingTasks._ This lookup happens at least once for every emit and consequently can happen millions of times per second.
> * Also use this for _JCQueue.localReceiveQueues_ where the basic idea is already in use but not in a reusable manner.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)