You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Hoss Man (JIRA)" <ji...@apache.org> on 2018/03/01 00:00:01 UTC
[jira] [Commented] (SOLR-12046)
TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory fails on every
windows build on jenkins.thetaphi.de ?
[ https://issues.apache.org/jira/browse/SOLR-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16381263#comment-16381263 ]
Hoss Man commented on SOLR-12046:
---------------------------------
bq. A quick glance at a single recent failure (i haven't dug in depth to others over history) shows that something about the test setup appears to be preventing the normal file cleanup from working...
Actually -- the more i look at it, the less convinced i am that it's a test setup problem -- we have other tests like TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory that also subclass UpdateProcessorTestBase and follow the same BeforeClass pattern of:
* {{testHome = createTempDir()}}
* copy an existing directory from {{src/test-files}} into this new temp dir
* call {{initCore(..., testHome)}}
...i think what's specifically happening here is that when the core is being shutdown by the test harness, something in the OpenNLPExtractNamedEntitiesUpdateProcessorFactory must not be closing these 3 bin files...
{noformat}
[junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-sent.bin: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-sent.bin
[junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-tokenizer.bin: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-tokenizer.bin
[junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-ner-person.bin: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-ner-person.bin
{noformat}
...which means when the test cleanup attempts to delete those files, the current JVM still has them open, and windows rejects the delete? (because that's what windows does w/attempts to delete open file handles IIRC)
> TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory fails on every windows build on jenkins.thetaphi.de ?
> ------------------------------------------------------------------------------------------------------------
>
> Key: SOLR-12046
> URL: https://issues.apache.org/jira/browse/SOLR-12046
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Hoss Man
> Priority: Major
>
> TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory has a fairly modest failures rate over the past 7 days of ~5% -- but if you drill down and look at the failures there is a very obvious pattern:
> * all of the failures are at the suite level
> * every failure is on jenkins.thetaphi.de
> * every failure is on Windows
> * failures are 50/50 master and branch_7x
> A quick glance at a single recent failure (i haven't dug in depth to others over history) shows that something about the test setup appears to be preventing the normal file cleanup from working...
> {noformat}
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory -Dtests.seed=1C7DCF1E2889E5C6 -Dtests.slow=true -Dtests.locale=sr-BA -Dtests.timezone=America/Monterrey -Dtests.asserts=true -Dtests.file.encoding=Cp1252
> [junit4] ERROR 0.00s J1 | TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory (suite) <<<
> [junit4] > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
> [junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf
> [junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1
> [junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001
> [junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-sent.bin: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-sent.bin
> [junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-tokenizer.bin: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-tokenizer.bin
> [junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-ner-person.bin: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001\tempDir-001\collection1\conf\en-test-ner-person.bin
> [junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\contrib\solr-analysis-extras\test\J1\temp\solr.update.processor.TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory_1C7DCF1E2889E5C6-001
> [junit4] > at __randomizedtesting.SeedInfo.seed([1C7DCF1E2889E5C6]:0)
> [junit4] > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
> [junit4] > at java.lang.Thread.run(Thread.java:748)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org