You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Michael McCandless (Jira)" <ji...@apache.org> on 2021/09/07 12:21:00 UTC

[jira] [Commented] (LUCENE-10088) Too many open files in TestIndexWriterMergePolicy.testStressUpdateSameDocumentWithMergeOnGetReader

    [ https://issues.apache.org/jira/browse/LUCENE-10088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411178#comment-17411178 ] 

Michael McCandless commented on LUCENE-10088:
---------------------------------------------

{noformat}
   >     com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=38, name=Thread-4, state=RUNNABLE, group=TGRP-TestIndexWriterMergePolicy]
   >
   >         Caused by:
   >         java.lang.AssertionError: java.nio.file.FileSystemException: /l/trunk/lucene/core/build/tmp/tests-tmp/lucene.index.TestIndexWriterMergePolicy_971E1D93B44F0009-001/index-NIOFSDirectory-001/_1r0_Lucene90FieldsIndexfile_pointers_3hy.tmp: Too\
 many open files
   >             at __randomizedtesting.SeedInfo.seed([971E1D93B44F0009]:0)
   >             at org.apache.lucene.index.TestIndexWriterMergePolicy.lambda$stressUpdateSameDocumentWithMergeOnX$4(TestIndexWriterMergePolicy.java:752)
   >             at java.base/java.lang.Thread.run(Thread.java:831)
   >
   >             Caused by:
   >             java.nio.file.FileSystemException: /l/trunk/lucene/core/build/tmp/tests-tmp/lucene.index.TestIndexWriterMergePolicy_971E1D93B44F0009-001/index-NIOFSDirectory-001/_1r0_Lucene90FieldsIndexfile_pointers_3hy.tmp: Too many open files
   >                 at org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:45)
   >                 at org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:82)
   >                 at org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:163)
   >                 at org.apache.lucene.mockfile.FilterFileSystemProvider.newOutputStream(FilterFileSystemProvider.java:194)
   >                 at java.base/java.nio.file.Files.newOutputStream(Files.java:224)
   >                 at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:392)
   >                 at org.apache.lucene.store.FSDirectory.createTempOutput(FSDirectory.java:234)
   >                 at org.apache.lucene.store.FileSwitchDirectory.createTempOutput(FileSwitchDirectory.java:198)
   >                 at org.apache.lucene.store.MockDirectoryWrapper.createTempOutput(MockDirectoryWrapper.java:745)
   >                 at org.apache.lucene.store.FilterDirectory.createTempOutput(FilterDirectory.java:81)
   >                 at org.apache.lucene.store.TrackingDirectoryWrapper.createTempOutput(TrackingDirectoryWrapper.java:49)
   >                 at org.apache.lucene.codecs.lucene90.compressing.FieldsIndexWriter.<init>(FieldsIndexWriter.java:87)
   >                 at org.apache.lucene.codecs.lucene90.compressing.Lucene90CompressingStoredFieldsWriter.<init>(Lucene90CompressingStoredFieldsWriter.java:148)
   >                 at org.apache.lucene.codecs.lucene90.compressing.Lucene90CompressingStoredFieldsFormat.fieldsWriter(Lucene90CompressingStoredFieldsFormat.java:140)
   >                 at org.apache.lucene.codecs.lucene90.Lucene90StoredFieldsFormat.fieldsWriter(Lucene90StoredFieldsFormat.java:154)
   >                 at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:49)
   >                 at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:56)
   >                 at org.apache.lucene.index.IndexingChain.startStoredFields(IndexingChain.java:556)
   >                 at org.apache.lucene.index.IndexingChain.processDocument(IndexingChain.java:587)
   >                 at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:239)
   >                 at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:432)
   >                 at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1530)
   >                 at org.apache.lucene.index.IndexWriter.softUpdateDocument(IndexWriter.java:1847)
   >                 at org.apache.lucene.index.RandomIndexWriter.updateDocument(RandomIndexWriter.java:298)
   >                 at org.apache.lucene.index.TestIndexWriterMergePolicy.lambda$stressUpdateSameDocumentWithMergeOnX$4(TestIndexWriterMergePolicy.java:746)
   >                 ... 1 more
  2> NOTE: reproduce with: gradlew test --tests TestIndexWriterMergePolicy.testStressUpdateSameDocumentWithMergeOnGetReader -Dtests.seed=971E1D93B44F0009 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.locale=qu-EC -Dtests.timezone\
=Asia/Vladivostok -Dtests.asserts=true -Dtests.file.encoding=UTF-8
  2> NOTE: leaving temporary files on disk at: /l/trunk/lucene/core/build/tmp/tests-tmp/lucene.index.TestIndexWriterMergePolicy_971E1D93B44F0009-001
  2> NOTE: test params are: codec=Lucene90, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=qu-EC, timezone=Asia/Vladivostok
  2> NOTE: Linux 5.13.12-arch1-1 amd64/N/A 16.0.2 (64-bit)/cpus=128,threads=1,free=113297584,total=268435456
  2> NOTE: All tests run in this JVM: [TestIndexWriterMergePolicy] {noformat}

> Too many open files in TestIndexWriterMergePolicy.testStressUpdateSameDocumentWithMergeOnGetReader
> --------------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-10088
>                 URL: https://issues.apache.org/jira/browse/LUCENE-10088
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Michael McCandless
>            Priority: Major
>
> [This build failure|https://ci-builds.apache.org/job/Lucene/job/Lucene-NightlyTests-main/386/] reproduces for me.  I'll try to dig.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org