You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Robert Muir (Jira)" <ji...@apache.org> on 2021/04/22 11:26:02 UTC
[jira] [Resolved] (LUCENE-9928) speed up analysis/icu regeneration
[ https://issues.apache.org/jira/browse/LUCENE-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir resolved LUCENE-9928.
---------------------------------
Fix Version/s: main (9.0)
Resolution: Fixed
> speed up analysis/icu regeneration
> ----------------------------------
>
> Key: LUCENE-9928
> URL: https://issues.apache.org/jira/browse/LUCENE-9928
> Project: Lucene - Core
> Issue Type: Task
> Reporter: Robert Muir
> Priority: Major
> Fix For: main (9.0)
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> This is relatively slow, on linux/mac we have to compile the icu4c library and then use the built tools to do the regeneration. Especially the compilation of the large library is currently slow.
> Let's make it a little less painful, e.g. use {{-O0}} as optimization isn't helpful and slows it down (its a throwaway method to get correctly versioned tools and run them once).
> Before:
> {noformat}
> > Task :lucene:analysis:icu:regenerate
> Aggregate task times (possibly running in parallel!):
> 160.78 sec. compileIcuLinux
> 15.09 sec. compileJava
> 1.51 sec. genUtr30DataFiles
> 1.49 sec. jar
> 0.79 sec. genRbbi
> 0.57 sec. gitStatus
> 0.25 sec. compileToolsJava
> 0.16 sec. processResources
> 0.04 sec. genRbbiChecksumLoad
> 0.02 sec. genRbbiChecksumSave
> 0.01 sec. genUtr30DataFilesChecksumLoad
> 0.01 sec. genUtr30DataFilesChecksumSave
> 0.00 sec. genUtr30DataFilesIfChanged
> 0.00 sec. genRbbiIfChanged
> 0.00 sec. errorProneSkipped
> {noformat}
> After:
> {noformat}
> > Task :lucene:analysis:icu:regenerate
> Aggregate task times (possibly running in parallel!):
> 126.86 sec. compileIcuLinux
> 15.78 sec. compileJava
> 1.57 sec. jar
> 1.35 sec. genUtr30DataFiles
> 0.81 sec. genRbbi
> 0.60 sec. gitStatus
> 0.24 sec. compileToolsJava
> 0.15 sec. processResources
> 0.04 sec. genRbbiChecksumLoad
> 0.02 sec. genRbbiChecksumSave
> 0.01 sec. genUtr30DataFilesChecksumLoad
> 0.00 sec. genUtr30DataFilesChecksumSave
> 0.00 sec. genRbbiIfChanged
> 0.00 sec. genUtr30DataFilesIfChanged
> 0.00 sec. errorProneSkipped
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org