You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/04/22 11:25:03 UTC
[jira] [Commented] (LUCENE-9928) speed up analysis/icu regeneration
[ https://issues.apache.org/jira/browse/LUCENE-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327961#comment-17327961 ]
ASF subversion and git services commented on LUCENE-9928:
---------------------------------------------------------
Commit 044d152d954f1e22aac5a53792011da54c680617 in lucene's branch refs/heads/main from Robert Muir
[ https://gitbox.apache.org/repos/asf?p=lucene.git;h=044d152 ]
LUCENE-9928: speed up analysis/icu regeneration (#82)
The compilation of the library is slow, disable optimization as it doesn't speed up our usage of the gennorm2 tool.
Use better heuristic for make parallelism (tests.jvms rather than just hardcoded value of four).
> speed up analysis/icu regeneration
> ----------------------------------
>
> Key: LUCENE-9928
> URL: https://issues.apache.org/jira/browse/LUCENE-9928
> Project: Lucene - Core
> Issue Type: Task
> Reporter: Robert Muir
> Priority: Major
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> This is relatively slow, on linux/mac we have to compile the icu4c library and then use the built tools to do the regeneration. Especially the compilation of the large library is currently slow.
> Let's make it a little less painful, e.g. use {{-O0}} as optimization isn't helpful and slows it down (its a throwaway method to get correctly versioned tools and run them once).
> Before:
> {noformat}
> > Task :lucene:analysis:icu:regenerate
> Aggregate task times (possibly running in parallel!):
> 160.78 sec. compileIcuLinux
> 15.09 sec. compileJava
> 1.51 sec. genUtr30DataFiles
> 1.49 sec. jar
> 0.79 sec. genRbbi
> 0.57 sec. gitStatus
> 0.25 sec. compileToolsJava
> 0.16 sec. processResources
> 0.04 sec. genRbbiChecksumLoad
> 0.02 sec. genRbbiChecksumSave
> 0.01 sec. genUtr30DataFilesChecksumLoad
> 0.01 sec. genUtr30DataFilesChecksumSave
> 0.00 sec. genUtr30DataFilesIfChanged
> 0.00 sec. genRbbiIfChanged
> 0.00 sec. errorProneSkipped
> {noformat}
> After:
> {noformat}
> > Task :lucene:analysis:icu:regenerate
> Aggregate task times (possibly running in parallel!):
> 126.86 sec. compileIcuLinux
> 15.78 sec. compileJava
> 1.57 sec. jar
> 1.35 sec. genUtr30DataFiles
> 0.81 sec. genRbbi
> 0.60 sec. gitStatus
> 0.24 sec. compileToolsJava
> 0.15 sec. processResources
> 0.04 sec. genRbbiChecksumLoad
> 0.02 sec. genRbbiChecksumSave
> 0.01 sec. genUtr30DataFilesChecksumLoad
> 0.00 sec. genUtr30DataFilesChecksumSave
> 0.00 sec. genRbbiIfChanged
> 0.00 sec. genUtr30DataFilesIfChanged
> 0.00 sec. errorProneSkipped
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org