You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (JIRA)" <ji...@apache.org> on 2011/07/23 14:43:09 UTC
[jira] [Created] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
jrebug causes porter stemmer to sigsegv
---------------------------------------
Key: LUCENE-3335
URL: https://issues.apache.org/jira/browse/LUCENE-3335
Project: Lucene - Java
Issue Type: Bug
Reporter: Robert Muir
happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3335:
----------------------------------
Environment:
- JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
- JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070055#comment-13070055 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
maybe my bug is a duplicate of this one: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070615#comment-13070615 ]
Dawid Weiss commented on LUCENE-3335:
-------------------------------------
fyi: I asked the gods of jit on hotspot-dev mailing list what's the cause of this.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-3335:
--------------------------------
Attachment: LUCENE-3335_slow.patch
heres a simple workaround, probably slows the filter down some.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139980#comment-13139980 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
See LUCENE-3537 and also the Lucene/Solr web homepage.
A complete report is here:
- [Main article|http://blog.thetaphi.de/2011/07/real-story-behind-java-7-ga-bugs.html]
- [Explanation of the string concat issues, this explains why StringConcat optimizations trigger this|http://blog.thetaphi.de/2011/10/gotocon-aarhus-2011.html]
- [Discussion about the update release|http://blog.thetaphi.de/2011/10/java-7-update-1-released-does-it-fix.html]
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073818#comment-13073818 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
The SIGSEGV bug was already reported on the Elastic Search mailing list in January: [http://elasticsearch-users.115913.n3.nabble.com/Java-6u23-and-ES-0-14-2-crashing-on-signal-6-SIGABT-td2289578.html]
It would have been nice, if Shay Bannon contacted us!
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069960#comment-13069960 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
yeah i think its a bad bug, obviously even casually using this stemmer will cause it to crash (this is no crazy random test but just stemming a file of a few thousand english words)
how do we vote -1 to release Java7 :)
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070027#comment-13070027 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
When applying your patch, Lucene core and modules build correctly, but solr fails on random tests with unreproducible error messages.
It seems that hotspot is totally broken in Java 7.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070057#comment-13070057 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
bq. wait, how do you know? Do all Solr tests pass with -Xint?
Solr tests also do not pass with -Xint. It seems to be a concurrency bug in Solr's caching. With caching disabled (in SolrIndexSearcher), tests pass except those which directly check cache contents. This affects TestFiltering, RequiredFieldsTest and more tests (fail randomly depending on load).
Another test randomly fails without reason: TestEchoParams (this test looks like chinese to me, I dont understand any single line and what is tested at all).
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070061#comment-13070061 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
I can confirm, Roberts fixes fix all bugs in Lucene & Modules (I used the "slow" one which is not slow :-) ). Solr tests no longer segfault when they use PorterStemFilter, but the above test failures are real and not hotspot related.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Mark Miller (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069965#comment-13069965 ]
Mark Miller commented on LUCENE-3335:
-------------------------------------
bq. http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134
This link does not work for me.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069963#comment-13069963 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
I opened a bug at sun, here are my 'steps to reproduce':
{noformat}
curl http://tartarus.org/~martin/PorterStemmer/java.txt > Stemmer.java
javac Stemmer.java
java Stemmer /usr/share/dict/words
{noformat}
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071519#comment-13071519 ]
Hoss Man commented on LUCENE-3335:
----------------------------------
Frankly i'm amazed that the jdk7 guys are saying "yes this is a bug that can cause a sigsegv in code that worked fine using Java 1.6, but we're going to go ahead and release 1.7 with this bug in place anyway, it should make it in by 1.7_u2"
makes me scared shitless of what other known bugs will be in Java 1.7.0.
Even if we found a work around for all the affected issues in Lucene that didn't hurt performance in older JVMs, and spun up a 3.3.1 RC in the next 5 minutes, we still don't have enough time to vote for that release and get it out to the mirrors by the time Java 7 comes out -- let alone have any confidence that all our users will upgrade Lucene/Solr before they upgrade their JVM.
I think the most important thing we can do is publicize the *shit* out of this hotspot bug, and warn everybody on the fucking planet not to use Java1.7.0 because of it.
if we also find clean workarounds we can commit and release in our own code, so be it -- but that seems like priority #2
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3335:
----------------------------------
Environment:
- JDK 7 Preview Release, GA (fixed in JDK 1.7.0_1)
- JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts (fixed in JDK 1.6.0_29)
was:
- JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
- JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (fixed in JDK 1.7.0_1)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts (fixed in JDK 1.6.0_29)
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069952#comment-13069952 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
{noformat}
[junit] Testsuite: org.apache.lucene.analysis.en.TestPorterStemFilter
[junit] #
[junit] # A fatal error has been detected by the Java Runtime Environment:
[junit] #
[junit] # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x0000000002348faf, pid=11080, tid=10288
[junit] #
[junit] # JRE version: 7.0-b147
[junit] # Java VM: Java HotSpot(TM) 64-Bit Server VM (21.0-b17 mixed mode windows-amd64 compressed oops)
[junit] # Problematic frame:
[junit] # J org.apache.lucene.analysis.en.PorterStemFilter.incrementToken()Z
[junit] #
[junit] # Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
[junit] #
[junit] # An error report file with more information is saved as:
[junit] # C:\Users\Uwe Schindler\Projects\lucene\trunk-lusolr3\modules\analysis\build\common\test\1\hs_err_pid11080.log
[junit] #
[junit] # If you would like to submit a bug report, please visit:
[junit] # http://bugreport.sun.com/bugreport/crash.jsp
[junit] #
[junit] Test org.apache.lucene.analysis.en.TestPorterStemFilter FAILED (crashed)
{noformat}
On each run, the problematic frame is different, sometimes incrementToken, sometimes BaseTokenStreamTestcase.assertTokenStreamContents, sometimes PorterStemmer.stem().
Somehow hotspot corrupts itsself.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071348#comment-13071348 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
Here the final patch for OpenJDK including Porter.java as testcase:
- [http://cr.openjdk.java.net/~kvn/7070134/webrev/7070134.patch] (see also [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005972.html], [http://cr.openjdk.java.net/~kvn/7070134/webrev/])
For the full bugfix, also the following fixes are needed:
- [http://cr.openjdk.java.net/~kvn/7044738/webrev/7044738.patch]
- [http://cr.openjdk.java.net/~kvn/7068051/webrev/7068051.patch]
All three were applied to Jenkins' OpenJDK7 (excluding the testcases).
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071494#comment-13071494 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
{quote}
Should we place a warning on the "Download" and "News" page on Solr and Lucene website? The risk is high that you corrupt your index, if you index using these JDK versions.
{quote}
Not totally sure, the issue is not so different from LUCENE-2975: if we can we make a easy workaround I think (there are 2 possible ones on this issue for the Porter bug), we give it our best try, and we get it out in a release. this way if someone has to support jdk 7, we can at least say, upgrade to this version of lucene rather than "won't fix". No matter how much we scream, users will be confused because it seems these bugs only affect loops of a very specific form.
On the other hand if it makes our code messy or confusing or slows things down, we should not do this.
I will look into this new negative vint bug, it might only affect pulsing, and see if i can make a test case+workaround for it.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071555#comment-13071555 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
{quote}
Even if we found a work around for all the affected issues in Lucene that didn't hurt performance in older JVMs, and spun up a 3.3.1 RC in the next 5 minutes, we still don't have enough time to vote for that release and get it out to the mirrors by the time Java 7 comes out – let alone have any confidence that all our users will upgrade Lucene/Solr before they upgrade their JVM.
{quote}
I agree, I'm not implying we should rush anything. But I guess I'm saying its worth it to understand the scope of what's affected, because if its just:
* PorterStemmer jrecrash <- workarounds already posted here
* Pulsing negative readVint <-- no workaround yet.
well, thats manageable, only one of these affects any released code.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069953#comment-13069953 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
i traced this down to the step4 method... maybe we can code it differently and dodge the bug.
e.g. this passes:
ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100 -Dargs="-XX:CompileCommand=exclude,org/apache/lucene/analysis/en/PorterStemmer,step4"
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071324#comment-13071324 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
Response from the Hotspot mailing list about their release plans:
{quote}
Thank you, Uwe
I will send the patch for reviews shortly.
About java 7 release. We are late to do any bugs fixes in GA which should happen soon. All loop optimization fixes will go definitely into jdk7 update 2. We will try to push them into update 1 (which is targeted only for security fixes) but we can't promise.
There is going discussion about using current Hotspot VM in future jdk6 updates but there is no decision yet. Note: current Hotspot VM sources are targeted for
JDK8 and jdk7 updates only.
Regards,
Vladimir
{quote}
This means, Java 7 will come out with heavy broken loops (so almost for any for or while loop you cannot make sure that it is still working correct when executed 10thousand times.
What do others mean. Should we place a warning on the "Download" and "News" page on Solr and Lucene website? The risk is high that you corrupt your index, if you index using these JDK versions. Also the default configuration of Solr will SIGSEGV.
We should also inform the user mailing lists.
I can prepare something and we can discuss? Oracle JDK 1.7.0 GA will be released on July 28th, according to Oracle's press releases. At least on that day we should have something available to present to the users.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-3335:
--------------------------------
Attachment: LUCENE-3335.patch
here's a better workaround, adds a redundant 'ch == 0' check.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071562#comment-13071562 ]
Dawid Weiss commented on LUCENE-3335:
-------------------------------------
@Hoss Yeah, it's scary, isn't it? But then: there is no piece of software that is 100% bug free and anybody running a production server will be running migration tests first before running on a new infrastructure. Hey, that's also part of the reason we still have folks running 1.5 :)
I think I'm for releasing 1.7 and getting the road paved for bugfix releases rather than delaying it indefinitely... I mean: it'll be motivational for Oracle if people start screaming!
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Bernd Fehling (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072783#comment-13072783 ]
Bernd Fehling commented on LUCENE-3335:
---------------------------------------
> I got new information from Vladimir about the Porter bug in Java 1.6: "The code in memnode.cpp was there
> for long time (before 6u26). But before my changes it was guarded by OptimizeStringConcat flag. So if you
> use -XX:+OptimizeStringConcat or -XX:+AggressiveOpts flags you will hit the same problem (I reproduced it
> even with 1.6.0_23)"
>
> This might be the reason behind http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm,
> but we never got a response. If he used aggressive opts he has the same problem.
@Uwe, sorry for not answering that one or creating an issue as Robert said, but while switching from FAST Search to Lucene/Solr I had (and still have) several problems to solve. One was the UTF-8 jetty problem, then this PorterStemFilter came up and right after that Solr/Lucene crashes with OOM due to FieldCache problems. And there is still my plan to get FST for synonyms running. Dang, my day only has 24 hours.
Yes, I used -XX:+AggressiveOpts and as we know now thats the cause why JVM chrashed.
java version "1.6.0_22"
Java(TM) SE Runtime Environment (build 1.6.0_22-b04)
Java HotSpot(TM) 64-Bit Server VM (build 17.1-b03, mixed mode)
After the crashes with PorterStemFilter I removed AggressiveOpts from my JAVA_OPTS.
Now I'm watching what Lucenes FieldCache is doing and if its still doubling its size until OOM.
So I'm deep inside :-)
Well interesting idea to know that if I had filed an issue and that that one had been traced down a month ago that this might have been prevented a buggy release of java 1.7 ;-)
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Mark Miller (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069973#comment-13069973 ]
Mark Miller commented on LUCENE-3335:
-------------------------------------
Yuck. Welcome to 1980 :)
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069951#comment-13069951 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
Passes with -Xint (but takes very long)
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071520#comment-13071520 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
I just wrote a test (Test10KPulsings) designed to seek out the corrupt index bug.
it didnt work, but it separately sometimes creates a corrupt index with java6 :)
Adding lucene/src/test/org/apache/lucene/index/codecs/pulsing
Adding lucene/src/test/org/apache/lucene/index/codecs/pulsing/Test10KPulsings.java
Transmitting file data .
Committed revision 1151335.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071567#comment-13071567 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
I got new information from Vladimir about the Porter bug in Java 1.6: "The code in memnode.cpp was there for long time (before 6u26). But before my changes it was guarded by OptimizeStringConcat flag. So if you use -XX:+OptimizeStringConcat or -XX:+AggressiveOpts flags you will hit the same problem (I reproduced it even with 1.6.0_23)"
This might be the reason behind [http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm], but we never got a response. If he used aggressive opts he has the same problem.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3335:
----------------------------------
Attachment: (was: patch-0uwe.patch)
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Issue Comment Edited] (LUCENE-3335) jrebug causes porter
stemmer to sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071575#comment-13071575 ]
Uwe Schindler edited comment on LUCENE-3335 at 7/27/11 7:20 AM:
----------------------------------------------------------------
I verified the above:
{noformat}
modules\analysis\common>ant test -Dargs="-XX:+OptimizeStringConcat" -Dtestcase=TestPorterStemFilter -Dtests.iter=100
modules\analysis\common>ant test -Dargs="-XX:+AggressiveOpts" -Dtestcase=TestPorterStemFilter -Dtests.iter=100
{noformat}
Both crash with the same error:
{noformat}
Testsuite: org.apache.lucene.analysis.en.TestPorterStemFilter
#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000022171e9, pid=8816, tid=10952
#
# JRE version: 6.0_24-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (19.1-b02 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# J org.apache.lucene.analysis.en.PorterStemmer.stem(I)Z
#
# An error report file with more information is saved as:
# C:\Users\Uwe Schindler\Projects\lucene\trunk-lusolr1\modules\analysis\build\common\test\1\hs_err_pid8816.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#
Test org.apache.lucene.analysis.en.TestPorterStemFilter FAILED (crashed)
{noformat}
This may explain Bernd Fehlings problems, as Solr users often use strange JVM options because they want to get all speed out of their system (because solr is slower than native Lucene code...).
was (Author: thetaphi):
I verified the above:
{noformat}
modules\analysis\common>ant test -Dargs="-XX:+OptimizeStringConcat -Xbatch" -Dtestcase=TestPorterStemFilter -Dtests.iter=100
modules\analysis\common>ant test -Dargs="-XX:+AggressiveOpts" -Dtestcase=TestPorterStemFilter -Dtests.iter=100
{noformat}
Both crash with the same error:
{noformat}
Testsuite: org.apache.lucene.analysis.en.TestPorterStemFilter
#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000022171e9, pid=8816, tid=10952
#
# JRE version: 6.0_24-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (19.1-b02 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# J org.apache.lucene.analysis.en.PorterStemmer.stem(I)Z
#
# An error report file with more information is saved as:
# C:\Users\Uwe Schindler\Projects\lucene\trunk-lusolr1\modules\analysis\build\common\test\1\hs_err_pid8816.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#
Test org.apache.lucene.analysis.en.TestPorterStemFilter FAILED (crashed)
{noformat}
This may explain Bernd Fehlings problems, as Solr users often use strange JVM options because they want to get all speed out of their system (because solr is slower than native Lucene code...).
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069956#comment-13069956 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
Solr tests never pass with Java7 because of that :(
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3335:
----------------------------------
Attachment: patch-0uwe.patch
Hi,
we had some success with direct communication to the hotspot developers.
The whole story:
- Java 7 contains a fix to the readVInt issue since 1.6.0_21 (approx, LUCENE-2975), this fix was fortunately not included in 1.6.0_26
- This fix causes the SIGSEGV on Porter code, but also breaks other loops (e.g. a strange CheckIndex failure in org.apache.lucene.facet.search.SamplingWrapperTest)
- We had contact to the hotspot-compiler-dev list and Vladimir sent me the patches, that should fix the bug. The attached patch is a combination of all patches received, in a format suitable for the FreeBSD ports build framework. Place the file in your port's "files/" folder and rebuild the package. In Debian/Ubuntu you should be able to do the same thing by placing the file in the debian/patches folder somehow.
- I have now disabled all jenkins builds and queued the Java 7 builds for 3.x and trunk quarter-hourly. The machine now stress tests.
- We will report the resuls back to Oracle, but it seems that the attached patch fixes the issues.
If they would have added their original broken fix to the 1.6.0_26 release it would have been catastrophic...
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069968#comment-13069968 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
{noformat}
You can monitor this bug on the Java Bug Database at
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134.
It may take a day or two before your bug shows up in this external database.
{noformat}
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076114#comment-13076114 ]
Dawid Weiss commented on LUCENE-3335:
-------------------------------------
Uwe has an Italian temper :) Btw. I really like the recent Yoda-discussion on concurrency-interest, Shay...
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir resolved LUCENE-3335.
---------------------------------
Resolution: Won't Fix
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076156#comment-13076156 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
I don't think there is any sense in this, who cares?
We reported this crash to Oracle in plenty of time, and the *worse* wrong-results bug has been open since May 13: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738, but Oracle decided not to fix that, too.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Assigned] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir reassigned LUCENE-3335:
-----------------------------------
Assignee: Robert Muir
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069964#comment-13069964 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071575#comment-13071575 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
I verified the above:
{noformat}
modules\analysis\common>ant test -Dargs="-XX:+OptimizeStringConcat -Xbatch" -Dtestcase=TestPorterStemFilter -Dtests.iter=100
modules\analysis\common>ant test -Dargs="-XX:+AggressiveOpts" -Dtestcase=TestPorterStemFilter -Dtests.iter=100
{noformat}
Both crash with the same error:
{noformat}
Testsuite: org.apache.lucene.analysis.en.TestPorterStemFilter
#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000022171e9, pid=8816, tid=10952
#
# JRE version: 6.0_24-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (19.1-b02 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# J org.apache.lucene.analysis.en.PorterStemmer.stem(I)Z
#
# An error report file with more information is saved as:
# C:\Users\Uwe Schindler\Projects\lucene\trunk-lusolr1\modules\analysis\build\common\test\1\hs_err_pid8816.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#
Test org.apache.lucene.analysis.en.TestPorterStemFilter FAILED (crashed)
{noformat}
This may explain Bernd Fehlings problems, as Solr users often use strange JVM options because they want to get all speed out of their system (because solr is slower than native Lucene code...).
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070603#comment-13070603 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
The bug is now visible at http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134
If anyone has a few minutes, it would be cool if they voted on it (the oracle site is horrendously slow, and i know thats discouraging).
I think there will be a lot of confusion if java 7 is released with this bug, for instance simple things like the solr example will not really work at all.
you don't need some crazy random test to trigger this, once this method passes the compile threshold, (e.g. 10k invocations) then boom.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070153#comment-13070153 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
I opened SOLR-2672 and SOLR-2673 for the Solr test failures.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3335:
----------------------------------
Attachment: patch-0uwe.patch
Patch again, without Apache License
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-3335:
--------------------------------
Affects Version/s: 4.0
3.4
1.9
1.9.1
2.0.0
2.1
2.2
2.3
2.3.1
2.3.2
2.4
2.4.1
2.9
2.9.1
2.9.2
2.9.3
2.9.4
3.0
3.0.1
3.0.2
3.0.3
3.1
3.2
3.3
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070661#comment-13070661 ]
Hoss Man commented on LUCENE-3335:
----------------------------------
Thread: http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005962.html
Suggested workarround: -XX:-UseLoopPredicate
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076132#comment-13076132 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
@Shay: Sorry I did not want to be too italian :-) I just wanted to ensure that such configurations, leading to bugs in JVMs, would be reported to us. It would help us to also respond quicker on such bug reports, like the one we already got 2 months ago (which nobody was able to reproduce, as we did not know that the user used aggressive opts).
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071610#comment-13071610 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
I opened a separate issue for the checkindex problem: LUCENE-3346
it only affects pulsing, and only unreleased trunk.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071326#comment-13071326 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
Link to the message: [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070016#comment-13070016 ]
Uwe Schindler commented on LUCENE-3335:
---------------------------------------
I like the first patch more, as the code is much easier to understand. I assume its not slower.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070047#comment-13070047 ]
Robert Muir commented on LUCENE-3335:
-------------------------------------
wait, how do you know? Do all Solr tests pass with -Xint?
Maybe there is some other issue affecting Solr, perhaps something XML related.
Please open up a separate JIRA issue for that: I don't want to confuse that stuff with this one.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Matt Ryall (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139863#comment-13139863 ]
Matt Ryall commented on LUCENE-3335:
------------------------------------
The [Java 7u1 release notes|http://www.oracle.com/technetwork/java/javase/7u1-relnotes-507962.html] report that this issue is fixed in that release:
{quote}
*JIT and Loop Bugs*
Three bugs reported by various parties, including Apache Lucene developers, have been fixed in JDK 7 Update 1, in addition to a fourth related bug found by Oracle (7070134, 7068051, 7044738, 7077439).
{quote}
I haven't yet been able to verify this.
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-3335:
--------------------------------
Description:
happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
was:
happens easily on java7: ant test -Dtestcase=TestPorterStemmer -Dtests.iter=100
might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
TestPorterStemmer -> TestPorterStemFilter
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Robert Muir
> Attachments: LUCENE-3335_slow.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Shay Banon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076053#comment-13076053 ]
Shay Banon commented on LUCENE-3335:
------------------------------------
@Uwe I actually forgot about this, and did not think it was because of the porter stemmer at the time, especially since I did try and reproduce it and never managed to (I thought it was coincidence it crashed there). From my experience, you get very little help from sun/oracle when using unorthodox flags like agressive opts without proper recreation. Well, you get very little help there even when you do produce recreation... (see this issue that I opened for example: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129) . I am the reason behind Lucene 1.9.1 release with the major bug in buffering introduced in 1.9 way back in the days, do you really think I would not contact if I thought there really was a problem associated with Lucene?
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (may also affect update _1, targeted fix is JDK 1.7.0_2)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3335) jrebug causes porter stemmer to
sigsegv
Posted by "Krystian Nowak (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170210#comment-13170210 ]
Krystian Nowak commented on LUCENE-3335:
----------------------------------------
Seems like finally done in 7u2:
http://www.oracle.com/technetwork/java/javase/2col/7u2bugfixes-1394661.html
> jrebug causes porter stemmer to sigsegv
> ---------------------------------------
>
> Key: LUCENE-3335
> URL: https://issues.apache.org/jira/browse/LUCENE-3335
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 1.9, 1.9.1, 2.0.0, 2.1, 2.2, 2.3, 2.3.1, 2.3.2, 2.4, 2.4.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 3.0, 3.0.1, 3.0.2, 3.0.3, 3.1, 3.2, 3.3, 3.4, 4.0
> Environment: - JDK 7 Preview Release, GA (fixed in JDK 1.7.0_1)
> - JDK 1.6.0_20+ with -XX:+OptimizeStringConcat or -XX:+AggressiveOpts (fixed in JDK 1.6.0_29)
> Reporter: Robert Muir
> Assignee: Robert Muir
> Labels: Java7
> Attachments: LUCENE-3335.patch, LUCENE-3335_slow.patch, patch-0uwe.patch
>
>
> happens easily on java7: ant test -Dtestcase=TestPorterStemFilter -Dtests.iter=100
> might happen on 1.6.0_u26 too, a user reported something that looks like the same bug already:
> http://www.lucidimagination.com/search/document/3beaa082c4d2fdd4/porterstemfilter_kills_jvm
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org