You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Uwe Schindler (JIRA)" <ji...@apache.org> on 2011/07/28 19:21:09 UTC
[jira] [Created] (LUCENE-3349) Place warning about today's released
Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
----------------------------------------------------------------------------------------------------------------
Key: LUCENE-3349
URL: https://issues.apache.org/jira/browse/LUCENE-3349
Project: Lucene - Java
Issue Type: Sub-task
Components: general/website
Environment: Java7
Reporter: Uwe Schindler
Assignee: Uwe Schindler
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING*
Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corrumption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers's fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corrumptions.
Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
{quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072458#comment-13072458 ]
Uwe Schindler commented on LUCENE-3349:
---------------------------------------
LowercaseFilter is dependent on unicode version...
Maybe we make it a little bit softer with "may need to reindex".
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3349) Place warning about today's released
Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3349:
----------------------------------
Component/s: (was: general/website)
general/test
Description:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]).
*Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing)!
{quote}
was:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING*
Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
{quote}
I changed the text a little bit taking Hoss' and Steven's comments into account.
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing)!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Steven Rowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072452#comment-13072452 ]
Steven Rowe commented on LUCENE-3349:
-------------------------------------
bq. In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
StandardTokenizer is not dependent on JVM Unicode version, so this statement is neither true in the strict sense nor in the "average" sense, assuming the "average" user employs StandardTokenizer/Analyzer.
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072437#comment-13072437 ]
Uwe Schindler commented on LUCENE-3349:
---------------------------------------
Should I also send this mail to announce@apache.org, so press/journalists also get the information? This would maybe make Oracle work faster :-)
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Issue Comment Edited] (LUCENE-3349) Place warning about
today's released Java7 version on Lucene/Solr/Root webpage's news and send
mail to java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073361#comment-13073361 ]
Uwe Schindler edited comment on LUCENE-3349 at 7/31/11 5:53 PM:
----------------------------------------------------------------
I posted an article in my (new) blog about the whole Java 7 issue: [http://blog.thetaphi.de/2011/07/real-story-behind-java-7-ga-bugs.html]
was (Author: thetaphi):
I posted an article in my (new) blog about the whole Java 7 issue: [http://blog.thetaphi.de/2011/07/real-story-behind-apache-lucene-solr.html]
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bugs [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346, ).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072444#comment-13072444 ]
Hoss Man commented on LUCENE-3349:
----------------------------------
I might even suggest tweaking the wording so that the initial para is generic info about how this is a potentially serious problem for *all* java applications (at least: ones that use loops) and then in the subsequent paragraphs mention specificly how it is known to affect Lucene/Solr.
that way it will be more visible to people who may not particularly care about Lucene/Solr (but do care about java)
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072529#comment-13072529 ]
Uwe Schindler commented on LUCENE-3349:
---------------------------------------
Sites updates in SVN and people.apache.org.
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bugs [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346, ).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072425#comment-13072425 ]
Robert Muir commented on LUCENE-3349:
-------------------------------------
+1
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corrumption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers's fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corrumptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072533#comment-13072533 ]
Uwe Schindler commented on LUCENE-3349:
---------------------------------------
Mail sent to announce@apache.org; general@lucene.apache.org; java-user@lucene.apache.org; solr-user@lucene.apache.org
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bugs [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346, ).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072493#comment-13072493 ]
Robert Muir commented on LUCENE-3349:
-------------------------------------
I would say maybe we should remove the advice about 'In case you upgrade to java 7', instead recommending that you *do not use* java 7.
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing)!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3349) Place warning about today's released
Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3349:
----------------------------------
Description:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]).
*Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
{quote}
was:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]).
*Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing)!
{quote}
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072440#comment-13072440 ]
Hoss Man commented on LUCENE-3349:
----------------------------------
bq. Should I also send this mail to announce@apache.org
Yes, this is exactly the type of thing that list is for...
http://www.apache.org/foundation/mailinglists.html
{quote}
The Apache Announcements list contains news and announcements about the foundation and its projects. Announcements of major software releases, new projects, *_and other important news_* are included. Messages are posted only by the Foundation; there is no discussion.
{quote}
(emphasis mine)
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072435#comment-13072435 ]
Michael McCandless commented on LUCENE-3349:
--------------------------------------------
+1 scary!
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073361#comment-13073361 ]
Uwe Schindler commented on LUCENE-3349:
---------------------------------------
I posted an article in my (new) blog about the whole Java 7 issue: [http://blog.thetaphi.de/2011/07/real-story-behind-apache-lucene-solr.html]
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bugs [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346, ).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3349) Place warning about today's released
Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-3349:
--------------------------------
Description:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING*
Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
{quote}
was:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING*
Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corrumption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers's fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corrumptions.
Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
{quote}
Uwe asked me to edit the typos, too bad because i really liked corrumption!!!!
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/website
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING*
> Oracle released *Java 7* today. Unfortunately it contains some hotspot compiler optimizations, which miscompile some loops in Lucene's code (this affects all versions released until today, see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]). Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). This means you cannot use Lucene/Solr with Java 7 releases before Update 2! If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if you use one of those JVM options, which are not enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In the case you upgrade to Java 7, remember that you have to reindex everything, as the unicode version shipped with Java 7 changed and tokenization behaves differently!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-3349) Place warning about today's
released Java7 version on Lucene/Solr/Root webpage's news and send mail to
java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler resolved LUCENE-3349.
-----------------------------------
Resolution: Fixed
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bugs [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346, ).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3349) Place warning about today's released
Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Schindler updated LUCENE-3349:
----------------------------------
Description:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bugs [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051]).
*Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346, ).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
{quote}
was:
Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
I propose the following text:
{quote}
*Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bug [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134]).
*Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346).
These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
{quote}
> Place warning about today's released Java7 version on Lucene/Solr/Root webpage's news and send mail to java-user
> ----------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-3349
> URL: https://issues.apache.org/jira/browse/LUCENE-3349
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: general/test
> Environment: Java7
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
>
> Today, JDK/JRE 1.7.0 GA was released by Oracle. Unfortunately they didn't fix the Hotspot problems affecting loops to be miscompiled (LUCENE-3335, LUCENE-3346). This can lead to Solr crashing with default configuration on startup or sudden index corrumption depending on configuration.
> We should send an email to the java-user and solr-user list describing the problem. Also place a note in the news section of Solr, Lucene Core and top-level website.
> I propose the following text:
> {quote}
> *Jul 28th, 2011: WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7*
> Oracle released *Java 7* today. Unfortunately it contains hotspot compiler optimizations, which miscompile some loops. This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases, results calculated can be incorrect, leading to bugs in applications (see Hotspot bugs [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738], [http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051]).
> *Apache Lucene Core* and *Apache Solr* are two Apache projects, which are affected by these bugs, namely all versions released until today. Solr users with the default configuration will have Java crashing with SIGSEGV as soon as they start to index documents, as one affected part is the well-known Porter stemmer (see LUCENE-3335). Other loops in Lucene may be miscompiled, too, leading to index corruption (especially on Lucene trunk with pulsing codec; other loops may be affected, too - LUCENE-3346, ).
> These problems were detected only 5 days before the official Java 7 release, so Oracle had no time to fix those bugs, affecting also many more applications. In response to our questions, they proposed to include the fixes into service release u2 (eventually into service release u1, see [http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html]). *This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!* If you do, please don't open bug reports, it is not the committers' fault! At least disable loop optimizations using the -XX:-UseLoopPredicate JVM options to not risk index corruptions.
> Please note: Also Java 6 users are affected, if they use one of those JVM options, which are *not* enabled by default: -XX:+OptimizeStringConcat or -XX:+AggressiveOpts
> It is strongly recommended not to use any hotspot optimization switches in any Java version without extensive testing!
> In case you upgrade to Java 7, remember that you may have to reindex, as the unicode version shipped with Java 7 changed and tokenization behaves differently (e.g. lowercasing). For more information, read JRE_VERSION_MIGRATION.txt in your distribution package!
> {quote}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org