You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@maven.apache.org by GitBox <gi...@apache.org> on 2022/04/28 10:40:22 UTC

[GitHub] [maven-indexer] cstamas opened a new pull request, #205: [MINDEXER-151] Proof of concept

cstamas opened a new pull request, #205:
URL: https://github.com/apache/maven-indexer/pull/205

   This change (ingesting GZIP files raw records into Lucene
   index on multiple threads) on my PC halves the execution time:
   while BasicUsageExample on master takes over 15 minutes to
   finish (when doing full update), this PR makes it under
   7 minutes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@maven.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [maven-indexer] cstamas commented on pull request #205: [MINDEXER-151] Proof of concept

Posted by GitBox <gi...@apache.org>.
cstamas commented on PR #205:
URL: https://github.com/apache/maven-indexer/pull/205#issuecomment-1286900272

   superseded by https://github.com/apache/maven-indexer/pull/255


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@maven.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [maven-indexer] cstamas closed pull request #205: [MINDEXER-151] Proof of concept

Posted by GitBox <gi...@apache.org>.
cstamas closed pull request #205: [MINDEXER-151] Proof of concept
URL: https://github.com/apache/maven-indexer/pull/205


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@maven.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [maven-indexer] cstamas commented on pull request #205: [MINDEXER-151] Proof of concept

Posted by GitBox <gi...@apache.org>.
cstamas commented on PR #205:
URL: https://github.com/apache/maven-indexer/pull/205#issuecomment-1112054020

   Console output just for ref:
   ```
   Updating Index...
   This might take a while on first run, so please be patient!
     Downloading nexus-maven-repository-index.properties - Done in 0 sec
     Downloading nexus-maven-repository-index.gz - Done in 18 sec
   [main] INFO org.apache.maven.index.updater.IndexDataReader - Reading index...
   [pool-1-thread-2] INFO org.apache.maven.index.updater.IndexDataReader - Starting thread pool-1-thread-2
   [pool-1-thread-1] INFO org.apache.maven.index.updater.IndexDataReader - Starting thread pool-1-thread-1
   [pool-1-thread-3] INFO org.apache.maven.index.updater.IndexDataReader - Starting thread pool-1-thread-3
   [pool-1-thread-6] INFO org.apache.maven.index.updater.IndexDataReader - Starting thread pool-1-thread-6
   [pool-1-thread-5] INFO org.apache.maven.index.updater.IndexDataReader - Starting thread pool-1-thread-5
   [pool-1-thread-4] INFO org.apache.maven.index.updater.IndexDataReader - Starting thread pool-1-thread-4
   [main] INFO org.apache.maven.index.updater.IndexDataReader - Signalling END
   [main] INFO org.apache.maven.index.updater.IndexDataReader - Shutting down threads
   [pool-1-thread-5] INFO org.apache.maven.index.updater.IndexDataReader - Done thread pool-1-thread-5
   [pool-1-thread-6] INFO org.apache.maven.index.updater.IndexDataReader - Done thread pool-1-thread-6
   [pool-1-thread-2] INFO org.apache.maven.index.updater.IndexDataReader - Done thread pool-1-thread-2
   [pool-1-thread-4] INFO org.apache.maven.index.updater.IndexDataReader - Done thread pool-1-thread-4
   [pool-1-thread-1] INFO org.apache.maven.index.updater.IndexDataReader - Done thread pool-1-thread-1
   [pool-1-thread-3] INFO org.apache.maven.index.updater.IndexDataReader - Done thread pool-1-thread-3
   [main] INFO org.apache.maven.index.updater.IndexDataReader - Commit...
   [main] INFO org.apache.maven.index.updater.IndexDataReader - Reading index done in 205 sec
   Full update happened!
   Finished in 440 sec
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@maven.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org