You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/07/10 04:20:00 UTC

[jira] [Commented] (STORM-3100) Minor optimization: Replace HashMap with an array backed data structure for faster lookups

    [ https://issues.apache.org/jira/browse/STORM-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16537969#comment-16537969 ] 

Jungtaek Lim commented on STORM-3100:
-------------------------------------

I would remove epic link for this, since this is rather improvement, not blocker for Storm 2.0.0. There's still a chance for this to be included in Storm 2.0.0 but shouldn't explicitly mark as a blocker.

> Minor optimization: Replace HashMap<Integer, T> with an array backed data structure for faster lookups
> ------------------------------------------------------------------------------------------------------
>
>                 Key: STORM-3100
>                 URL: https://issues.apache.org/jira/browse/STORM-3100
>             Project: Apache Storm
>          Issue Type: Improvement
>            Reporter: Roshan Naik
>            Assignee: Roshan Naik
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> * Introduce _CustomIndexArray_: An array backed data structure to speedup HashMap<Integer, T> use cases *in critical path*. It needs to supported -ve indexing and a user defined (on construction) Upper and Lower Index range. Does not need to be dynamically resizable given the nature of use cases we have.
>  * Use this data structure for _GeneralTopologyContext._taskToComponent_ mapping which is looked up in the critical path _Task.getOutgoingTasks._ This lookup happens at least once for every emit and consequently can happen millions of times per second.
>  * Also use this for _JCQueue.localReceiveQueues_ where the basic idea is already in use but not in a reusable manner.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)