[jira] [Commented] (SOLR-14275) Policy calculations are very slow for large clusters and large operations

["David Smiley (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SOLR-14275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085191#comment-17085191 ] 

David Smiley commented on SOLR-14275:
-------------------------------------

[~noble.paul] I recall from a slack message a few weeks ago that you made _tremendous_ progress.  I'm guessing that's the most recent PR which corresponds to the same timeframe.  What's the next step?  Known gotchas / TODOs / trade-offs?  Does it need a code review?

> Policy calculations are very slow for large clusters and large operations
> -------------------------------------------------------------------------
>
>                 Key: SOLR-14275
>                 URL: https://issues.apache.org/jira/browse/SOLR-14275
>             Project: Solr
>          Issue Type: Bug
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: AutoScaling
>    Affects Versions: 7.7.2, 8.4.1
>            Reporter: Andrzej Bialecki
>            Assignee: Andrzej Bialecki
>            Priority: Major
>              Labels: scaling
>         Attachments: SOLR-14275.patch, scenario.txt
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Replica placement calculations performed during collection creation take extremely long time (several minutes) when using a large cluster and creating a large collection (eg. 1000 nodes, 500 shards, 4 replicas).
> Profiling shows that most of the time is spent in {{Row.computeCacheIfAbsent}}, which probably doesn't reuse this cache as much as it should.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org