You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by bu...@apache.org on 2012/02/04 22:11:31 UTC
svn commit: r803947 [2/3] - in /websites/staging/lucene/trunk/content: ./
core/ openrelevance/ pylucene/ pylucene/jcc/ solr/
Modified: websites/staging/lucene/trunk/content/pylucene/jcc/features.html
==============================================================================
--- websites/staging/lucene/trunk/content/pylucene/jcc/features.html (original)
+++ websites/staging/lucene/trunk/content/pylucene/jcc/features.html Sat Feb 4 21:11:30 2012
@@ -1,5 +1,5 @@
-<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
-<html>
+
+<!-- main.html -->
<head>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
@@ -18,7 +18,9 @@
limitations under the License.
-->
- <link href="css/global.css" rel="stylesheet" type="text/css">
+
+ <link href="./css/global.css" rel="stylesheet" type="text/css">
+
<title>Apache Lucene - </title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta http-equiv="Content-Type" content="text/html;charset=UTF-8"/>
@@ -27,12 +29,14 @@
<meta name="keywords"
content="apache, apache lucene, apache solr, solr, lucene
search, information retrieval, spell checking, faceting, inverted index, open source"/>
+
<link rel="shortcut icon" type="image/x-icon" href="images/favicon.ico"/>
-<script type="text/javascript" src="scripts/prototype.js"></script>
-<script type="text/javascript" src="scripts/effects.js"></script>
-<script type="text/javascript" src="scripts/search.js"></script>
-<script type="text/javascript" src="scripts/slides.js"></script>
+<script type="text/javascript" src="./scripts/prototype.js"></script>
+<script type="text/javascript" src="./scripts/effects.js"></script>
+<script type="text/javascript" src="./scripts/search.js"></script>
+<script type="text/javascript" src="./scripts/slides.js"></script>
+
<!--<script type="text/javascript" src="scripts/jquery.js"></script>-->
</head>
@@ -936,6 +940,392 @@ doc = hits[i]
'doc:(I)Lorg/apache/lucene/document/Document;'
</source></p></div>
+<div><h1 id="news">News</h1>
+<h2 id="27_november_2011_-_lucene_core_350_and_solr_350_availabletitle">27 November 2011 - Lucene Core 3.5.0 and Solr 3.5.0 Available</title></h2>
+<div class="codehilite"><pre> <span class="n">The</span> <span class="n">Lucene</span> <span class="n">PMC</span> <span class="n">is</span> <span class="n">pleased</span> <span class="n">to</span> <span class="n">announce</span> <span class="n">the</span> <span class="n">availability</span> <span class="n">of</span> <span class="n">Apache</span> <span class="n">Lucene</span> <span class="mf">3.5.0</span> <span class="ow">and</span> <span class="n">Apache</span> <span class="n">Solr</span> <span class="mf">3.5.0</span><span class="o">.</span>
+</pre></div>
+
+
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a></p>
+<p>Highlights of the Lucene release include:</p>
+<ul>
+<li>
+<p>Added a very substantial (3-5X) RAM reduction required to hold the
+terms index on opening an IndexReader. (<a href="https://issues.apache.org/jira/browse/LUCENE-2205">LUCENE-2205</a>)</p>
+</li>
+<li>
+<p>Added IndexSearcher.searchAfter which returns results after a
+specified ScoreDoc (e.g. last document on the previous page) to
+support deep paging use cases.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-2215">LUCENE-2215</a>)</p>
+</li>
+<li>
+<p>Added SearcherManager to manage sharing and reopening IndexSearchers
+across multiple search threads. Underlying IndexReader instances are
+safely closed if not referenced anymore.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3445">LUCENE-3445</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-3558">LUCENE-3558</a>)</p>
+</li>
+<li>
+<p>Added SearcherLifetimeManager which safely provides a consistent
+view of the index across multiple requests (e.g. paging/drilldown).
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3558">LUCENE-3558</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-3486">LUCENE-3486</a>)</p>
+</li>
+<li>
+<p>Renamed IndexWriter.optimize to forceMerge to discourage use of
+this method since it is horribly costly and rarely justified anymore.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3454">LUCENE-3454</a>)</p>
+</li>
+<li>
+<p>Added NGramPhraseQuery that speeds up phrase queries 30-50% when
+ n-gram analysis is used. (<a href="https://issues.apache.org/jira/browse/LUCENE-3426">LUCENE-3426</a>)</p>
+</li>
+<li>
+<p>Added a new reopen API (IndexReader.openIfChanged) that returns
+null instead of the old reader if there are no changes in the index.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3464">LUCENE-3464</a>)</p>
+</li>
+<li>
+<p>Improvements to vector highlighting: support for more queries
+such as wildcards and boundary analysis for generated snippets.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-1824">LUCENE-1824</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-1889">LUCENE-1889</a>)</p>
+</li>
+<li>
+<p>IndexSearcher and IndexReader now perform additional checks to
+throw AlreadyClosedExceptions if searches are performed on a
+closed IndexReader. Performing searches on already closed reader can
+cause JVM crashes when invalid memory mapped files are referenced. </p>
+</li>
+<li>
+<p>Several bugfixes, including a bug where closing an NRT reader
+after the writer was closed was incorrectly invoking the
+DeletionPolicy. See CHANGES.txt entries for full details.</p>
+</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>
+<p>Bug fixes and improvements from Apache Lucene 3.5.0, including a
+ very substantial (3-5X) RAM reduction required to hold the terms
+ index on opening an <code>IndexReader</code>.
+ (<a href="https://issues.apache.org/jira/browse/LUCENE-2205">LUCENE-2205</a>)</p>
+</li>
+<li>
+<p>Added support for distributed result grouping.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2066">SOLR-2066</a>,
+ <a href="https://issues.apache.org/jira/browse/SOLR-2776">SOLR-2776</a>)</p>
+</li>
+<li>
+<p>Added support for Hunspell stemmer <code>TokenFilter</code> supporting
+ stemming for 99 languages.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2769">SOLR-2769</a>)</p>
+</li>
+<li>
+<p>A new contrib module "langid" adds language identification
+ capabilities as an Update Processor, using Tika's
+ <code>LanguageIdentifier</code> or Cybozu language-detection library
+ (<a href="https://issues.apache.org/jira/browse/SOLR-1979">SOLR-1979</a>)</p>
+</li>
+<li>
+<p>Numeric types including Trie and date types now support
+ <code>sortMissingFirst</code>/<code>Last</code>.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2881">SOLR-2881</a>)</p>
+</li>
+<li>
+<p>Added <code>hl.q</code> parameter. It is optional and if it is specified,
+ it overrides <code>q</code> parameter in <code>Highlighter</code>.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-1926">SOLR-1926</a>)</p>
+</li>
+<li>
+<p>Several minor bugfixes like date parsing for years from 0001-1000, ignored
+ configurations when using <code>QueryAnalyzer</code> with
+ <code>SpellCheckComponent</code> and many more.
+ See CHANGES.txt entries for full details.</p>
+</li>
+</ul>
+<h2 id="26_october_2011_-_java_7u1_fixes_index_corruption_and_crash_bugs_in_apache_lucene_core_and_apache_solrtitle">26 October 2011 - Java 7u1 fixes index corruption and crash bugs in Apache Lucene Core and Apache Solr</title></h2>
+<p>Oracle released <a href="http://www.oracle.com/technetwork/java/javase/7u1-relnotes-507962.html">Java 7u1</a> on October 19.
+ According to the release notes and tests done by the Lucene committers, all bugs reported on July 28 are fixed in this release,
+ so code using Porter stemmer no longer crashes with <code>SIGSEGV</code>. We were not able to experience any index corruption anymore,
+ so it is safe to use Java 7u1 with Lucene Core and Solr.
+ On the same day, Oracle released <a href="http://www.oracle.com/technetwork/java/javase/6u29-relnotes-507960.html">Java 6u29</a>
+ fixing the same problems occurring with Java 6, if the JVM switches <code>-XX:+AggressiveOpts</code>
+ or <code>-XX:+OptimizeStringConcat</code> were used. Of course, you should <strong>not</strong> use experimental JVM options like
+ <code>-XX:+AggressiveOpts</code> in production environments! We recommend everybody to upgrade to this latest version 6u29.
+ In case you upgrade to Java 7, remember that you may have to reindex, as the unicode
+ version shipped with Java 7 changed and tokenization behaves differently
+ (e.g. lowercasing). For more information, read <code>JRE_VERSION_MIGRATION.txt</code>
+ in your distribution package!</p>
+<h2 id="14_september_2011_-_lucene_core_340_and_solr_340_availabletitle">14 September 2011 - Lucene Core 3.4.0 and Solr 3.4.0 Available</title></h2>
+<div class="codehilite"><pre> The Lucene PMC is pleased to announce the availability of Apache Lucene 3.4.0 and Apache Solr 3.4.0.
+
+ Lucene can be downloaded from <span class="nt"><a</span> <span class="na">href=</span><span class="s">"http://www.apache.org/dyn/closer.cgi/lucene/java/"</span><span class="nt">></span>http://www.apache.org/dyn/closer.cgi/lucene/java/<span class="nt"></a></span> and Solr can be downloaded from <span class="nt"><a</span> <span class="na">href=</span><span class="s">"http://www.apache.org/dyn/closer.cgi/lucene/solr/"</span><span class="nt">></span>http://www.apache.org/dyn/closer.cgi/lucene/solr/<span class="nt"></a></span>
+</pre></div>
+
+
+<p>If you are already using Apache Lucene 3.1, 3.2 or 3.3, we strongly recommend you upgrade to 3.4.0 because of the index corruption bug on OS or computer crash or power loss (<a href="https://issues.apache.org/jira/browse/LUCENE-3418">LUCENE-3418</a>), now fixed in 3.4.0.</p>
+<p>Highlights of the Lucene release include:</p>
+<ul>
+<li>
+<p>Fixed a major bug (<a href="https://issues.apache.org/jira/browse/LUCENE-3418">LUCENE-3418</a>) whereby a Lucene index could
+easily become corrupted if the OS or computer crashed or lost
+power.</p>
+</li>
+<li>
+<p>Added a new faceting module (<code>contrib/facet</code>) for computing facet
+counts (both hierarchical and non-hierarchical) at search
+time (<a href="https://issues.apache.org/jira/browse/LUCENE-3079">LUCENE-3079</a>).</p>
+</li>
+<li>
+<p>Added a new join module (<code>contrib/join</code>), enabling indexing and
+searching of nested (parent/child) documents using
+<code>BlockJoinQuery</code>/<code>Collector</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3171">LUCENE-3171</a>).</p>
+</li>
+<li>
+<p>It is now possible to index documents with term frequencies
+included but without positions (<a href="https://issues.apache.org/jira/browse/LUCENE-2048">LUCENE-2048</a>); previously
+<code>omitTermFreqAndPositions</code> always omitted both.</p>
+</li>
+<li>
+<p>The modular <code>QueryParser</code> (<code>contrib/queryparser</code>) can now create
+<code>NumericRangeQuery</code>.</p>
+</li>
+<li>
+<p>Added SynonymFilter, in <code>contrib/analyzers</code>, to apply multi-word
+synonyms during indexing or querying, including parsers to read
+the wordnet and solr synonym formats (<a href="https://issues.apache.org/jira/browse/LUCENE-3233">LUCENE-3233</a>).</p>
+</li>
+<li>
+<p>You can now control how documents that don't have a value on the
+sort field should sort (<a href="https://issues.apache.org/jira/browse/LUCENE-3390">LUCENE-3390</a>), using <code>SortField.setMissingValue</code>.</p>
+</li>
+<li>
+<p>Fixed a case where term vectors could be silently deleted from the
+index after <code>addIndexes</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3402">LUCENE-3402</a>).</p>
+</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>
+<p>SolrJ client can now parse grouped and range facets results
+(<a href="https://issues.apache.org/jira/browse/SOLR-2523">SOLR-2523</a>).</p>
+</li>
+<li>
+<p>A new <code>XsltUpdateRequestHandler</code> allows posting XML that's
+transformed by a provided XSLT into a valid Solr document
+(<a href="https://issues.apache.org/jira/browse/SOLR-2630">SOLR-2630</a>).</p>
+</li>
+<li>
+<p>Post-group faceting option (<code>group.truncate</code>) can now compute
+facet counts for only the highest ranking documents per-group.
+(<a href="https://issues.apache.org/jira/browse/SOLR-2665">SOLR-2665</a>).</p>
+</li>
+<li>
+<p>Add <code>commitWithin</code> update request parameter to all update handlers
+that were previously missing it. This tells Solr to commit the
+change within the specified amount of time (<a href="https://issues.apache.org/jira/browse/SOLR-2540">SOLR-2540</a>).</p>
+</li>
+<li>
+<p>You can now specify <code>NIOFSDirectory</code> (<a href="https://issues.apache.org/jira/browse/SOLR-2670">SOLR-2670</a>).</p>
+</li>
+<li>
+<p>New parameter <code>hl.phraseLimit</code> speeds up <code>FastVectorHighlighter</code>
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3234">LUCENE-3234</a>).</p>
+</li>
+<li>
+<p>The query cache and filter cache can now be disabled per request.
+See <a href="http://wiki.apache.org/solr/CommonQueryParameters#Caching_of_filters">this wiki page</a>
+(<a href="https://issues.apache.org/jira/browse/SOLR-2429">SOLR-2429</a>).</p>
+</li>
+<li>
+<p>Improved memory usage, build time, and performance of
+<code>SynonymFilterFactory</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3233">LUCENE-3233</a>).</p>
+</li>
+<li>
+<p>Added <code>omitPositions</code> to the schema, so you can omit position
+information while still indexing term frequencies (<a href="https://issues.apache.org/jira/browse/LUCENE-2048">LUCENE-2048</a>).</p>
+</li>
+<li>
+<p>Various fixes for multi-threaded <code>DataImportHandler</code>.</p>
+</li>
+</ul>
+<h2 id="28_july_2011_-_warning_index_corruption_and_crashes_in_apache_lucene_core__apache_solr_with_java_7">28 July 2011 - WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7</h2>
+<p>Oracle released <a href="http://www.oracle.com/technetwork/java/javase/downloads/index.html">Java 7</a> today.
+Unfortunately it contains hotspot compiler optimizations, which miscompile some loops.
+This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases,
+results calculated can be incorrect, leading to bugs in applications
+(see Hotspot bugs <a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134">7070134</a>,
+<a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738">7044738</a>,
+<a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051">7068051</a>).
+<strong>Apache Lucene Core</strong> and <strong>Apache Solr</strong> are two Apache projects,
+which are affected by these bugs, namely all versions released until today.
+Solr users with the default configuration will have
+Java crashing with <code>SIGSEGV</code> as soon as they start to index documents, as one
+affected part is the well-known Porter stemmer
+(see <a href="https://issues.apache.org/jira/browse/LUCENE-3335">LUCENE-3335</a>).
+Other loops in Lucene may be miscompiled, too, leading to index corruption
+(especially on Lucene trunk with pulsing codec; other loops may be
+affected, too - <a href="https://issues.apache.org/jira/browse/LUCENE-3346">LUCENE-3346</a>).
+These problems were detected only 5 days before the official Java 7 release,
+so Oracle had no time to fix those bugs, affecting also many more applications.
+In response to our questions, they proposed to include the fixes into service
+release u2 (eventually into service release u1, see
+<a href="http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html">this mail</a>).
+<strong>This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!</strong>
+If you do, please don't open bug reports, it is not the committers' fault!
+At least disable loop optimizations using the <code>-XX:-UseLoopPredicate</code> JVM option
+to not risk index corruptions.
+<em>Please note:</em> Also Java 6 users are affected, if they use one of those
+JVM options, which are <strong>not</strong> enabled by default: <code>-XX:+OptimizeStringConcat</code>
+or <code>-XX:+AggressiveOpts</code>.
+It is strongly recommended not to use any hotspot optimization switches in any Java
+version without extensive testing!
+In case you upgrade to Java 7, remember that you may have to reindex, as the unicode
+version shipped with Java 7 changed and tokenization behaves differently
+(e.g. lowercasing). For more information, read <code>JRE_VERSION_MIGRATION.txt</code>
+in your distribution package!</p>
+<h2 id="1_july_2011_-_lucene_core_33_and_solr_33_available">1 July 2011 - Lucene Core 3.3 and Solr 3.3 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.3 and Apache Solr 3.3.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>The spellchecker module now includes suggest/auto-complete functionality,
+ with three implementations: Jaspell, Ternary Trie, and Finite State.</li>
+<li>Support for merging results from multiple shards, for both "normal"
+ search results (TopDocs.merge) as well as grouped results using the
+ grouping module (SearchGroup.merge, TopGroups.merge).</li>
+<li>An optimized implementation of KStem, a less aggressive stemmer
+ for English</li>
+<li>Single-pass grouping implementation based on block document indexing.</li>
+<li>Improvements to MMapDirectory (now also the default implementation
+ returned by FSDirectory.open on 64-bit Linux).</li>
+<li>NRTManager simplifies handling near-real-time search with multiple
+ search threads, allowing the application to control which indexing
+ changes must be visible to which search requests.</li>
+<li>TwoPhaseCommitTool facilitates performing a multi-resource
+ two-phased commit, including IndexWriter.</li>
+<li>The default merge policy, TieredMergePolicy, has a new method
+ (set/getReclaimDeletesWeight) to control how aggressively it
+ targets segments with deletions, and is now more aggressive than
+ before by default.</li>
+<li>PKIndexSplitter tool splits an index by a mid-point term.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Grouping / Field Collapsing</li>
+<li>A new, automaton-based suggest/autocomplete implementation offering an
+ order of magnitude smaller RAM consumption.</li>
+<li>KStemFilterFactory, an optimized implementation of a less aggressive
+ stemmer for English.</li>
+<li>Solr defaults to a new, more efficient merge policy (TieredMergePolicy).
+ See <a href="http://s.apache.org/merging">http://s.apache.org/merging</a> for more information.</li>
+<li>Important bugfixes, including extremely high RAM usage in spellchecking.</li>
+<li>Bugfixes and improvements from Apache Lucene 3.3</li>
+</ul>
+<h2 id="4_june_2011_-_lucene_core_32_and_solr_32_available">4 June 2011 - Lucene Core 3.2 and Solr 3.2 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.2 and Apache Solr 3.2.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>A new grouping module, under lucene/contrib/grouping, enables
+ search results to be grouped by a single-valued indexed field</li>
+<li>A new IndexUpgrader tool fully converts an old index to the
+ current format.</li>
+<li>A new Directory implementation, NRTCachingDirectory, caches small
+ segments in RAM, to reduce the I/O load for applications with fast
+ NRT reopen rates.</li>
+<li>A new Collector implementation, CachingCollector, is able to
+ gather search hits (document IDs and optionally also scores) and
+ then replay them. This is useful for Collectors that require two
+ or more passes to produce results.</li>
+<li>Index a document block using IndexWriter's new addDocuments or
+ updateDocuments methods. These experimental APIs ensure that the
+ block of documents will forever remain contiguous in the index,
+ enabling interesting future features like grouping and joins.</li>
+<li>A new default merge policy, TieredMergePolicy, which is more
+ efficient due to being able to merge non-contiguous segments.
+ See <a href="http://s.apache.org/merging">http://s.apache.org/merging</a> for details.</li>
+<li>NumericField is now returned correctly when you load a stored
+ document (previously you received a normal Field back, with the
+ numeric value converted string).</li>
+<li>Deleted terms are now applied during flushing to the newly flushed
+ segment, which is more efficient than having to later initialize a
+ reader for that segment.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Ability to specify overwrite and commitWithin as request parameters when
+ using the JSON update format.</li>
+<li>TermQParserPlugin, useful when generating filter queries from terms
+ returned from field faceting or the terms component.</li>
+<li>DebugComponent now supports using a NamedList to model Explanation objects
+ in its responses instead of Explanation.toString.</li>
+<li>Improvements to the UIMA and Carrot2 integrations.</li>
+<li>Highlighting performance improvements. </li>
+<li>A test-framework jar for easy testing of Solr extensions.</li>
+<li>Bugfixes and improvements from Apache Lucene 3.2. </li>
+</ul>
+<h2 id="31_march_2011_-_lucene_core_31_and_solr_31_available">31 March 2011 - Lucene Core 3.1 and Solr 3.1 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.1 and Apache Solr 3.1.
+The version number for Solr 3.1 was chosen to reflect the merge of
+development with Lucene, which is currently also on 3.1. Going
+forward, we expect the Solr version to be the same as the Lucene
+version. Solr 3.1 contains Lucene 3.1 and is the release after Solr 1.4.1.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>Numerous performance improvements: faster exact PhraseQuery; merging
+favors segments with deletions; primary key lookup is faster;
+IndexWriter.addIndexes(Directory[]) uses file copy instead of
+merging; various Directory performance improvements; compound file
+is dynamically turned off for large segments; fully deleted segments
+are dropped on commit; faster snowball analyzers (in contrib);
+ConcurrentMergeScheduler is more careful about setting priority of
+merge threads.</li>
+<li>ReusableAnalyzerBase makes it easier to reuse TokenStreams
+correctly.</li>
+<li>Improved Analysis capabilities: Improved Unicode support, including
+Unicode 4, more friendly term handling (CharTermAttribute), easier
+object reuse and better support for protected words in lossy token
+filters (e.g. stemmers).</li>
+<li>ConstantScoreQuery now allows directly wrapping a Query.</li>
+<li>IndexWriter is now configured with a new separate builder API,
+IndexWriterConfig. You can now control IndexWriter's previously
+fixed internal thread limit by calling setMaxThreadStates.</li>
+<li>IndexWriter.getReader is replaced by IndexReader.open(IndexWriter).
+In addition you can now specify whether deletes should be resolved
+when you open an NRT reader.</li>
+<li>MultiSearcher is deprecated; ParallelMultiSearcher has been
+absorbed directly into IndexSearcher.</li>
+<li>On 64bit Windows and Solaris JVMs, MMapDirectory is now the
+default implementation (returned by FSDirectory.open).
+MMapDirectory also enables unmapping if the JVM supports it.</li>
+<li>New TotalHitCountCollector just counts total number of hits.</li>
+<li>ReaderFinishedListener API enables external caches to evict entries
+once a segment is finished.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Numeric range facets (similar to date faceting).</li>
+<li>New spatial search, including spatial filtering, boosting and sorting capabilities.</li>
+<li>Example Velocity driven search UI at http://localhost:8983/solr/browse</li>
+<li>A new termvector-based highlighter</li>
+<li>Extend dismax (edismax) query parser which addresses some
+missing features in the dismax query parser along with some
+extensions.</li>
+<li>Several more components now support distributed mode:
+TermsComponent, SpellCheckComponent.</li>
+<li>A new Auto Suggest component.</li>
+<li>Ability to sort by functions.</li>
+<li>JSON document indexing.</li>
+<li>CSV response format.</li>
+<li>Apache UIMA integration for metadata extraction.</li>
+<li>Leverages Lucene 3.1 and it's inherent optimizations and bug fixes
+as well as new analysis capabilities.</li>
+<li>Numerous improvements, bug fixes, and optimizations.</li>
+</ul></div>
@@ -999,5 +1389,4 @@ doc = hits[i]
</script>
</body>
-</html>
Modified: websites/staging/lucene/trunk/content/pylucene/jcc/index.html
==============================================================================
--- websites/staging/lucene/trunk/content/pylucene/jcc/index.html (original)
+++ websites/staging/lucene/trunk/content/pylucene/jcc/index.html Sat Feb 4 21:11:30 2012
@@ -1,5 +1,5 @@
-<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
-<html>
+
+<!-- main.html -->
<head>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
@@ -18,7 +18,9 @@
limitations under the License.
-->
- <link href="css/global.css" rel="stylesheet" type="text/css">
+
+ <link href="./css/global.css" rel="stylesheet" type="text/css">
+
<title>Apache Lucene - Welcome to JCC, PyLucene's code generator</title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta http-equiv="Content-Type" content="text/html;charset=UTF-8"/>
@@ -27,12 +29,14 @@
<meta name="keywords"
content="apache, apache lucene, apache solr, solr, lucene
search, information retrieval, spell checking, faceting, inverted index, open source"/>
+
<link rel="shortcut icon" type="image/x-icon" href="images/favicon.ico"/>
-<script type="text/javascript" src="scripts/prototype.js"></script>
-<script type="text/javascript" src="scripts/effects.js"></script>
-<script type="text/javascript" src="scripts/search.js"></script>
-<script type="text/javascript" src="scripts/slides.js"></script>
+<script type="text/javascript" src="./scripts/prototype.js"></script>
+<script type="text/javascript" src="./scripts/effects.js"></script>
+<script type="text/javascript" src="./scripts/search.js"></script>
+<script type="text/javascript" src="./scripts/slides.js"></script>
+
<!--<script type="text/javascript" src="scripts/jquery.js"></script>-->
</head>
@@ -150,6 +154,392 @@ a subversion client from
<p>If you'd like to contribute to JCC or are having issues or questions
with JCC, please subscribe to the PyLucene developer <a href="site:resources/contact">mailing list</a></p></div>
+<div><h1 id="news">News</h1>
+<h2 id="27_november_2011_-_lucene_core_350_and_solr_350_availabletitle">27 November 2011 - Lucene Core 3.5.0 and Solr 3.5.0 Available</title></h2>
+<div class="codehilite"><pre> <span class="n">The</span> <span class="n">Lucene</span> <span class="n">PMC</span> <span class="n">is</span> <span class="n">pleased</span> <span class="n">to</span> <span class="n">announce</span> <span class="n">the</span> <span class="n">availability</span> <span class="n">of</span> <span class="n">Apache</span> <span class="n">Lucene</span> <span class="mf">3.5.0</span> <span class="ow">and</span> <span class="n">Apache</span> <span class="n">Solr</span> <span class="mf">3.5.0</span><span class="o">.</span>
+</pre></div>
+
+
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a></p>
+<p>Highlights of the Lucene release include:</p>
+<ul>
+<li>
+<p>Added a very substantial (3-5X) RAM reduction required to hold the
+terms index on opening an IndexReader. (<a href="https://issues.apache.org/jira/browse/LUCENE-2205">LUCENE-2205</a>)</p>
+</li>
+<li>
+<p>Added IndexSearcher.searchAfter which returns results after a
+specified ScoreDoc (e.g. last document on the previous page) to
+support deep paging use cases.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-2215">LUCENE-2215</a>)</p>
+</li>
+<li>
+<p>Added SearcherManager to manage sharing and reopening IndexSearchers
+across multiple search threads. Underlying IndexReader instances are
+safely closed if not referenced anymore.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3445">LUCENE-3445</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-3558">LUCENE-3558</a>)</p>
+</li>
+<li>
+<p>Added SearcherLifetimeManager which safely provides a consistent
+view of the index across multiple requests (e.g. paging/drilldown).
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3558">LUCENE-3558</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-3486">LUCENE-3486</a>)</p>
+</li>
+<li>
+<p>Renamed IndexWriter.optimize to forceMerge to discourage use of
+this method since it is horribly costly and rarely justified anymore.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3454">LUCENE-3454</a>)</p>
+</li>
+<li>
+<p>Added NGramPhraseQuery that speeds up phrase queries 30-50% when
+ n-gram analysis is used. (<a href="https://issues.apache.org/jira/browse/LUCENE-3426">LUCENE-3426</a>)</p>
+</li>
+<li>
+<p>Added a new reopen API (IndexReader.openIfChanged) that returns
+null instead of the old reader if there are no changes in the index.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3464">LUCENE-3464</a>)</p>
+</li>
+<li>
+<p>Improvements to vector highlighting: support for more queries
+such as wildcards and boundary analysis for generated snippets.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-1824">LUCENE-1824</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-1889">LUCENE-1889</a>)</p>
+</li>
+<li>
+<p>IndexSearcher and IndexReader now perform additional checks to
+throw AlreadyClosedExceptions if searches are performed on a
+closed IndexReader. Performing searches on already closed reader can
+cause JVM crashes when invalid memory mapped files are referenced. </p>
+</li>
+<li>
+<p>Several bugfixes, including a bug where closing an NRT reader
+after the writer was closed was incorrectly invoking the
+DeletionPolicy. See CHANGES.txt entries for full details.</p>
+</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>
+<p>Bug fixes and improvements from Apache Lucene 3.5.0, including a
+ very substantial (3-5X) RAM reduction required to hold the terms
+ index on opening an <code>IndexReader</code>.
+ (<a href="https://issues.apache.org/jira/browse/LUCENE-2205">LUCENE-2205</a>)</p>
+</li>
+<li>
+<p>Added support for distributed result grouping.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2066">SOLR-2066</a>,
+ <a href="https://issues.apache.org/jira/browse/SOLR-2776">SOLR-2776</a>)</p>
+</li>
+<li>
+<p>Added support for Hunspell stemmer <code>TokenFilter</code> supporting
+ stemming for 99 languages.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2769">SOLR-2769</a>)</p>
+</li>
+<li>
+<p>A new contrib module "langid" adds language identification
+ capabilities as an Update Processor, using Tika's
+ <code>LanguageIdentifier</code> or Cybozu language-detection library
+ (<a href="https://issues.apache.org/jira/browse/SOLR-1979">SOLR-1979</a>)</p>
+</li>
+<li>
+<p>Numeric types including Trie and date types now support
+ <code>sortMissingFirst</code>/<code>Last</code>.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2881">SOLR-2881</a>)</p>
+</li>
+<li>
+<p>Added <code>hl.q</code> parameter. It is optional and if it is specified,
+ it overrides <code>q</code> parameter in <code>Highlighter</code>.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-1926">SOLR-1926</a>)</p>
+</li>
+<li>
+<p>Several minor bugfixes like date parsing for years from 0001-1000, ignored
+ configurations when using <code>QueryAnalyzer</code> with
+ <code>SpellCheckComponent</code> and many more.
+ See CHANGES.txt entries for full details.</p>
+</li>
+</ul>
+<h2 id="26_october_2011_-_java_7u1_fixes_index_corruption_and_crash_bugs_in_apache_lucene_core_and_apache_solrtitle">26 October 2011 - Java 7u1 fixes index corruption and crash bugs in Apache Lucene Core and Apache Solr</title></h2>
+<p>Oracle released <a href="http://www.oracle.com/technetwork/java/javase/7u1-relnotes-507962.html">Java 7u1</a> on October 19.
+ According to the release notes and tests done by the Lucene committers, all bugs reported on July 28 are fixed in this release,
+ so code using Porter stemmer no longer crashes with <code>SIGSEGV</code>. We were not able to experience any index corruption anymore,
+ so it is safe to use Java 7u1 with Lucene Core and Solr.
+ On the same day, Oracle released <a href="http://www.oracle.com/technetwork/java/javase/6u29-relnotes-507960.html">Java 6u29</a>
+ fixing the same problems occurring with Java 6, if the JVM switches <code>-XX:+AggressiveOpts</code>
+ or <code>-XX:+OptimizeStringConcat</code> were used. Of course, you should <strong>not</strong> use experimental JVM options like
+ <code>-XX:+AggressiveOpts</code> in production environments! We recommend everybody to upgrade to this latest version 6u29.
+ In case you upgrade to Java 7, remember that you may have to reindex, as the unicode
+ version shipped with Java 7 changed and tokenization behaves differently
+ (e.g. lowercasing). For more information, read <code>JRE_VERSION_MIGRATION.txt</code>
+ in your distribution package!</p>
+<h2 id="14_september_2011_-_lucene_core_340_and_solr_340_availabletitle">14 September 2011 - Lucene Core 3.4.0 and Solr 3.4.0 Available</title></h2>
+<div class="codehilite"><pre> The Lucene PMC is pleased to announce the availability of Apache Lucene 3.4.0 and Apache Solr 3.4.0.
+
+ Lucene can be downloaded from <span class="nt"><a</span> <span class="na">href=</span><span class="s">"http://www.apache.org/dyn/closer.cgi/lucene/java/"</span><span class="nt">></span>http://www.apache.org/dyn/closer.cgi/lucene/java/<span class="nt"></a></span> and Solr can be downloaded from <span class="nt"><a</span> <span class="na">href=</span><span class="s">"http://www.apache.org/dyn/closer.cgi/lucene/solr/"</span><span class="nt">></span>http://www.apache.org/dyn/closer.cgi/lucene/solr/<span class="nt"></a></span>
+</pre></div>
+
+
+<p>If you are already using Apache Lucene 3.1, 3.2 or 3.3, we strongly recommend you upgrade to 3.4.0 because of the index corruption bug on OS or computer crash or power loss (<a href="https://issues.apache.org/jira/browse/LUCENE-3418">LUCENE-3418</a>), now fixed in 3.4.0.</p>
+<p>Highlights of the Lucene release include:</p>
+<ul>
+<li>
+<p>Fixed a major bug (<a href="https://issues.apache.org/jira/browse/LUCENE-3418">LUCENE-3418</a>) whereby a Lucene index could
+easily become corrupted if the OS or computer crashed or lost
+power.</p>
+</li>
+<li>
+<p>Added a new faceting module (<code>contrib/facet</code>) for computing facet
+counts (both hierarchical and non-hierarchical) at search
+time (<a href="https://issues.apache.org/jira/browse/LUCENE-3079">LUCENE-3079</a>).</p>
+</li>
+<li>
+<p>Added a new join module (<code>contrib/join</code>), enabling indexing and
+searching of nested (parent/child) documents using
+<code>BlockJoinQuery</code>/<code>Collector</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3171">LUCENE-3171</a>).</p>
+</li>
+<li>
+<p>It is now possible to index documents with term frequencies
+included but without positions (<a href="https://issues.apache.org/jira/browse/LUCENE-2048">LUCENE-2048</a>); previously
+<code>omitTermFreqAndPositions</code> always omitted both.</p>
+</li>
+<li>
+<p>The modular <code>QueryParser</code> (<code>contrib/queryparser</code>) can now create
+<code>NumericRangeQuery</code>.</p>
+</li>
+<li>
+<p>Added SynonymFilter, in <code>contrib/analyzers</code>, to apply multi-word
+synonyms during indexing or querying, including parsers to read
+the wordnet and solr synonym formats (<a href="https://issues.apache.org/jira/browse/LUCENE-3233">LUCENE-3233</a>).</p>
+</li>
+<li>
+<p>You can now control how documents that don't have a value on the
+sort field should sort (<a href="https://issues.apache.org/jira/browse/LUCENE-3390">LUCENE-3390</a>), using <code>SortField.setMissingValue</code>.</p>
+</li>
+<li>
+<p>Fixed a case where term vectors could be silently deleted from the
+index after <code>addIndexes</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3402">LUCENE-3402</a>).</p>
+</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>
+<p>SolrJ client can now parse grouped and range facets results
+(<a href="https://issues.apache.org/jira/browse/SOLR-2523">SOLR-2523</a>).</p>
+</li>
+<li>
+<p>A new <code>XsltUpdateRequestHandler</code> allows posting XML that's
+transformed by a provided XSLT into a valid Solr document
+(<a href="https://issues.apache.org/jira/browse/SOLR-2630">SOLR-2630</a>).</p>
+</li>
+<li>
+<p>Post-group faceting option (<code>group.truncate</code>) can now compute
+facet counts for only the highest ranking documents per-group.
+(<a href="https://issues.apache.org/jira/browse/SOLR-2665">SOLR-2665</a>).</p>
+</li>
+<li>
+<p>Add <code>commitWithin</code> update request parameter to all update handlers
+that were previously missing it. This tells Solr to commit the
+change within the specified amount of time (<a href="https://issues.apache.org/jira/browse/SOLR-2540">SOLR-2540</a>).</p>
+</li>
+<li>
+<p>You can now specify <code>NIOFSDirectory</code> (<a href="https://issues.apache.org/jira/browse/SOLR-2670">SOLR-2670</a>).</p>
+</li>
+<li>
+<p>New parameter <code>hl.phraseLimit</code> speeds up <code>FastVectorHighlighter</code>
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3234">LUCENE-3234</a>).</p>
+</li>
+<li>
+<p>The query cache and filter cache can now be disabled per request.
+See <a href="http://wiki.apache.org/solr/CommonQueryParameters#Caching_of_filters">this wiki page</a>
+(<a href="https://issues.apache.org/jira/browse/SOLR-2429">SOLR-2429</a>).</p>
+</li>
+<li>
+<p>Improved memory usage, build time, and performance of
+<code>SynonymFilterFactory</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3233">LUCENE-3233</a>).</p>
+</li>
+<li>
+<p>Added <code>omitPositions</code> to the schema, so you can omit position
+information while still indexing term frequencies (<a href="https://issues.apache.org/jira/browse/LUCENE-2048">LUCENE-2048</a>).</p>
+</li>
+<li>
+<p>Various fixes for multi-threaded <code>DataImportHandler</code>.</p>
+</li>
+</ul>
+<h2 id="28_july_2011_-_warning_index_corruption_and_crashes_in_apache_lucene_core__apache_solr_with_java_7">28 July 2011 - WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7</h2>
+<p>Oracle released <a href="http://www.oracle.com/technetwork/java/javase/downloads/index.html">Java 7</a> today.
+Unfortunately it contains hotspot compiler optimizations, which miscompile some loops.
+This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases,
+results calculated can be incorrect, leading to bugs in applications
+(see Hotspot bugs <a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134">7070134</a>,
+<a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738">7044738</a>,
+<a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051">7068051</a>).
+<strong>Apache Lucene Core</strong> and <strong>Apache Solr</strong> are two Apache projects,
+which are affected by these bugs, namely all versions released until today.
+Solr users with the default configuration will have
+Java crashing with <code>SIGSEGV</code> as soon as they start to index documents, as one
+affected part is the well-known Porter stemmer
+(see <a href="https://issues.apache.org/jira/browse/LUCENE-3335">LUCENE-3335</a>).
+Other loops in Lucene may be miscompiled, too, leading to index corruption
+(especially on Lucene trunk with pulsing codec; other loops may be
+affected, too - <a href="https://issues.apache.org/jira/browse/LUCENE-3346">LUCENE-3346</a>).
+These problems were detected only 5 days before the official Java 7 release,
+so Oracle had no time to fix those bugs, affecting also many more applications.
+In response to our questions, they proposed to include the fixes into service
+release u2 (eventually into service release u1, see
+<a href="http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html">this mail</a>).
+<strong>This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!</strong>
+If you do, please don't open bug reports, it is not the committers' fault!
+At least disable loop optimizations using the <code>-XX:-UseLoopPredicate</code> JVM option
+to not risk index corruptions.
+<em>Please note:</em> Also Java 6 users are affected, if they use one of those
+JVM options, which are <strong>not</strong> enabled by default: <code>-XX:+OptimizeStringConcat</code>
+or <code>-XX:+AggressiveOpts</code>.
+It is strongly recommended not to use any hotspot optimization switches in any Java
+version without extensive testing!
+In case you upgrade to Java 7, remember that you may have to reindex, as the unicode
+version shipped with Java 7 changed and tokenization behaves differently
+(e.g. lowercasing). For more information, read <code>JRE_VERSION_MIGRATION.txt</code>
+in your distribution package!</p>
+<h2 id="1_july_2011_-_lucene_core_33_and_solr_33_available">1 July 2011 - Lucene Core 3.3 and Solr 3.3 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.3 and Apache Solr 3.3.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>The spellchecker module now includes suggest/auto-complete functionality,
+ with three implementations: Jaspell, Ternary Trie, and Finite State.</li>
+<li>Support for merging results from multiple shards, for both "normal"
+ search results (TopDocs.merge) as well as grouped results using the
+ grouping module (SearchGroup.merge, TopGroups.merge).</li>
+<li>An optimized implementation of KStem, a less aggressive stemmer
+ for English</li>
+<li>Single-pass grouping implementation based on block document indexing.</li>
+<li>Improvements to MMapDirectory (now also the default implementation
+ returned by FSDirectory.open on 64-bit Linux).</li>
+<li>NRTManager simplifies handling near-real-time search with multiple
+ search threads, allowing the application to control which indexing
+ changes must be visible to which search requests.</li>
+<li>TwoPhaseCommitTool facilitates performing a multi-resource
+ two-phased commit, including IndexWriter.</li>
+<li>The default merge policy, TieredMergePolicy, has a new method
+ (set/getReclaimDeletesWeight) to control how aggressively it
+ targets segments with deletions, and is now more aggressive than
+ before by default.</li>
+<li>PKIndexSplitter tool splits an index by a mid-point term.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Grouping / Field Collapsing</li>
+<li>A new, automaton-based suggest/autocomplete implementation offering an
+ order of magnitude smaller RAM consumption.</li>
+<li>KStemFilterFactory, an optimized implementation of a less aggressive
+ stemmer for English.</li>
+<li>Solr defaults to a new, more efficient merge policy (TieredMergePolicy).
+ See <a href="http://s.apache.org/merging">http://s.apache.org/merging</a> for more information.</li>
+<li>Important bugfixes, including extremely high RAM usage in spellchecking.</li>
+<li>Bugfixes and improvements from Apache Lucene 3.3</li>
+</ul>
+<h2 id="4_june_2011_-_lucene_core_32_and_solr_32_available">4 June 2011 - Lucene Core 3.2 and Solr 3.2 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.2 and Apache Solr 3.2.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>A new grouping module, under lucene/contrib/grouping, enables
+ search results to be grouped by a single-valued indexed field</li>
+<li>A new IndexUpgrader tool fully converts an old index to the
+ current format.</li>
+<li>A new Directory implementation, NRTCachingDirectory, caches small
+ segments in RAM, to reduce the I/O load for applications with fast
+ NRT reopen rates.</li>
+<li>A new Collector implementation, CachingCollector, is able to
+ gather search hits (document IDs and optionally also scores) and
+ then replay them. This is useful for Collectors that require two
+ or more passes to produce results.</li>
+<li>Index a document block using IndexWriter's new addDocuments or
+ updateDocuments methods. These experimental APIs ensure that the
+ block of documents will forever remain contiguous in the index,
+ enabling interesting future features like grouping and joins.</li>
+<li>A new default merge policy, TieredMergePolicy, which is more
+ efficient due to being able to merge non-contiguous segments.
+ See <a href="http://s.apache.org/merging">http://s.apache.org/merging</a> for details.</li>
+<li>NumericField is now returned correctly when you load a stored
+ document (previously you received a normal Field back, with the
+ numeric value converted string).</li>
+<li>Deleted terms are now applied during flushing to the newly flushed
+ segment, which is more efficient than having to later initialize a
+ reader for that segment.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Ability to specify overwrite and commitWithin as request parameters when
+ using the JSON update format.</li>
+<li>TermQParserPlugin, useful when generating filter queries from terms
+ returned from field faceting or the terms component.</li>
+<li>DebugComponent now supports using a NamedList to model Explanation objects
+ in its responses instead of Explanation.toString.</li>
+<li>Improvements to the UIMA and Carrot2 integrations.</li>
+<li>Highlighting performance improvements. </li>
+<li>A test-framework jar for easy testing of Solr extensions.</li>
+<li>Bugfixes and improvements from Apache Lucene 3.2. </li>
+</ul>
+<h2 id="31_march_2011_-_lucene_core_31_and_solr_31_available">31 March 2011 - Lucene Core 3.1 and Solr 3.1 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.1 and Apache Solr 3.1.
+The version number for Solr 3.1 was chosen to reflect the merge of
+development with Lucene, which is currently also on 3.1. Going
+forward, we expect the Solr version to be the same as the Lucene
+version. Solr 3.1 contains Lucene 3.1 and is the release after Solr 1.4.1.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>Numerous performance improvements: faster exact PhraseQuery; merging
+favors segments with deletions; primary key lookup is faster;
+IndexWriter.addIndexes(Directory[]) uses file copy instead of
+merging; various Directory performance improvements; compound file
+is dynamically turned off for large segments; fully deleted segments
+are dropped on commit; faster snowball analyzers (in contrib);
+ConcurrentMergeScheduler is more careful about setting priority of
+merge threads.</li>
+<li>ReusableAnalyzerBase makes it easier to reuse TokenStreams
+correctly.</li>
+<li>Improved Analysis capabilities: Improved Unicode support, including
+Unicode 4, more friendly term handling (CharTermAttribute), easier
+object reuse and better support for protected words in lossy token
+filters (e.g. stemmers).</li>
+<li>ConstantScoreQuery now allows directly wrapping a Query.</li>
+<li>IndexWriter is now configured with a new separate builder API,
+IndexWriterConfig. You can now control IndexWriter's previously
+fixed internal thread limit by calling setMaxThreadStates.</li>
+<li>IndexWriter.getReader is replaced by IndexReader.open(IndexWriter).
+In addition you can now specify whether deletes should be resolved
+when you open an NRT reader.</li>
+<li>MultiSearcher is deprecated; ParallelMultiSearcher has been
+absorbed directly into IndexSearcher.</li>
+<li>On 64bit Windows and Solaris JVMs, MMapDirectory is now the
+default implementation (returned by FSDirectory.open).
+MMapDirectory also enables unmapping if the JVM supports it.</li>
+<li>New TotalHitCountCollector just counts total number of hits.</li>
+<li>ReaderFinishedListener API enables external caches to evict entries
+once a segment is finished.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Numeric range facets (similar to date faceting).</li>
+<li>New spatial search, including spatial filtering, boosting and sorting capabilities.</li>
+<li>Example Velocity driven search UI at http://localhost:8983/solr/browse</li>
+<li>A new termvector-based highlighter</li>
+<li>Extend dismax (edismax) query parser which addresses some
+missing features in the dismax query parser along with some
+extensions.</li>
+<li>Several more components now support distributed mode:
+TermsComponent, SpellCheckComponent.</li>
+<li>A new Auto Suggest component.</li>
+<li>Ability to sort by functions.</li>
+<li>JSON document indexing.</li>
+<li>CSV response format.</li>
+<li>Apache UIMA integration for metadata extraction.</li>
+<li>Leverages Lucene 3.1 and it's inherent optimizations and bug fixes
+as well as new analysis capabilities.</li>
+<li>Numerous improvements, bug fixes, and optimizations.</li>
+</ul></div>
@@ -213,4 +603,3 @@ with JCC, please subscribe to the PyLuce
</script>
</body>
-</html>
Modified: websites/staging/lucene/trunk/content/pylucene/jcc/install.html
==============================================================================
--- websites/staging/lucene/trunk/content/pylucene/jcc/install.html (original)
+++ websites/staging/lucene/trunk/content/pylucene/jcc/install.html Sat Feb 4 21:11:30 2012
@@ -1,5 +1,5 @@
-<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
-<html>
+
+<!-- main.html -->
<head>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
@@ -18,7 +18,9 @@
limitations under the License.
-->
- <link href="css/global.css" rel="stylesheet" type="text/css">
+
+ <link href="./css/global.css" rel="stylesheet" type="text/css">
+
<title>Apache Lucene - </title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta http-equiv="Content-Type" content="text/html;charset=UTF-8"/>
@@ -27,12 +29,14 @@
<meta name="keywords"
content="apache, apache lucene, apache solr, solr, lucene
search, information retrieval, spell checking, faceting, inverted index, open source"/>
+
<link rel="shortcut icon" type="image/x-icon" href="images/favicon.ico"/>
-<script type="text/javascript" src="scripts/prototype.js"></script>
-<script type="text/javascript" src="scripts/effects.js"></script>
-<script type="text/javascript" src="scripts/search.js"></script>
-<script type="text/javascript" src="scripts/slides.js"></script>
+<script type="text/javascript" src="./scripts/prototype.js"></script>
+<script type="text/javascript" src="./scripts/effects.js"></script>
+<script type="text/javascript" src="./scripts/search.js"></script>
+<script type="text/javascript" src="./scripts/slides.js"></script>
+
<!--<script type="text/javascript" src="scripts/jquery.js"></script>-->
</head>
@@ -303,6 +307,392 @@ python2.3 instead of python2.4.</p>
</li>
</ul></div>
+<div><h1 id="news">News</h1>
+<h2 id="27_november_2011_-_lucene_core_350_and_solr_350_availabletitle">27 November 2011 - Lucene Core 3.5.0 and Solr 3.5.0 Available</title></h2>
+<div class="codehilite"><pre> <span class="n">The</span> <span class="n">Lucene</span> <span class="n">PMC</span> <span class="n">is</span> <span class="n">pleased</span> <span class="n">to</span> <span class="n">announce</span> <span class="n">the</span> <span class="n">availability</span> <span class="n">of</span> <span class="n">Apache</span> <span class="n">Lucene</span> <span class="mf">3.5.0</span> <span class="ow">and</span> <span class="n">Apache</span> <span class="n">Solr</span> <span class="mf">3.5.0</span><span class="o">.</span>
+</pre></div>
+
+
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a></p>
+<p>Highlights of the Lucene release include:</p>
+<ul>
+<li>
+<p>Added a very substantial (3-5X) RAM reduction required to hold the
+terms index on opening an IndexReader. (<a href="https://issues.apache.org/jira/browse/LUCENE-2205">LUCENE-2205</a>)</p>
+</li>
+<li>
+<p>Added IndexSearcher.searchAfter which returns results after a
+specified ScoreDoc (e.g. last document on the previous page) to
+support deep paging use cases.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-2215">LUCENE-2215</a>)</p>
+</li>
+<li>
+<p>Added SearcherManager to manage sharing and reopening IndexSearchers
+across multiple search threads. Underlying IndexReader instances are
+safely closed if not referenced anymore.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3445">LUCENE-3445</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-3558">LUCENE-3558</a>)</p>
+</li>
+<li>
+<p>Added SearcherLifetimeManager which safely provides a consistent
+view of the index across multiple requests (e.g. paging/drilldown).
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3558">LUCENE-3558</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-3486">LUCENE-3486</a>)</p>
+</li>
+<li>
+<p>Renamed IndexWriter.optimize to forceMerge to discourage use of
+this method since it is horribly costly and rarely justified anymore.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3454">LUCENE-3454</a>)</p>
+</li>
+<li>
+<p>Added NGramPhraseQuery that speeds up phrase queries 30-50% when
+ n-gram analysis is used. (<a href="https://issues.apache.org/jira/browse/LUCENE-3426">LUCENE-3426</a>)</p>
+</li>
+<li>
+<p>Added a new reopen API (IndexReader.openIfChanged) that returns
+null instead of the old reader if there are no changes in the index.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3464">LUCENE-3464</a>)</p>
+</li>
+<li>
+<p>Improvements to vector highlighting: support for more queries
+such as wildcards and boundary analysis for generated snippets.
+(<a href="https://issues.apache.org/jira/browse/LUCENE-1824">LUCENE-1824</a>,
+<a href="https://issues.apache.org/jira/browse/LUCENE-1889">LUCENE-1889</a>)</p>
+</li>
+<li>
+<p>IndexSearcher and IndexReader now perform additional checks to
+throw AlreadyClosedExceptions if searches are performed on a
+closed IndexReader. Performing searches on already closed reader can
+cause JVM crashes when invalid memory mapped files are referenced. </p>
+</li>
+<li>
+<p>Several bugfixes, including a bug where closing an NRT reader
+after the writer was closed was incorrectly invoking the
+DeletionPolicy. See CHANGES.txt entries for full details.</p>
+</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>
+<p>Bug fixes and improvements from Apache Lucene 3.5.0, including a
+ very substantial (3-5X) RAM reduction required to hold the terms
+ index on opening an <code>IndexReader</code>.
+ (<a href="https://issues.apache.org/jira/browse/LUCENE-2205">LUCENE-2205</a>)</p>
+</li>
+<li>
+<p>Added support for distributed result grouping.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2066">SOLR-2066</a>,
+ <a href="https://issues.apache.org/jira/browse/SOLR-2776">SOLR-2776</a>)</p>
+</li>
+<li>
+<p>Added support for Hunspell stemmer <code>TokenFilter</code> supporting
+ stemming for 99 languages.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2769">SOLR-2769</a>)</p>
+</li>
+<li>
+<p>A new contrib module "langid" adds language identification
+ capabilities as an Update Processor, using Tika's
+ <code>LanguageIdentifier</code> or Cybozu language-detection library
+ (<a href="https://issues.apache.org/jira/browse/SOLR-1979">SOLR-1979</a>)</p>
+</li>
+<li>
+<p>Numeric types including Trie and date types now support
+ <code>sortMissingFirst</code>/<code>Last</code>.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-2881">SOLR-2881</a>)</p>
+</li>
+<li>
+<p>Added <code>hl.q</code> parameter. It is optional and if it is specified,
+ it overrides <code>q</code> parameter in <code>Highlighter</code>.
+ (<a href="https://issues.apache.org/jira/browse/SOLR-1926">SOLR-1926</a>)</p>
+</li>
+<li>
+<p>Several minor bugfixes like date parsing for years from 0001-1000, ignored
+ configurations when using <code>QueryAnalyzer</code> with
+ <code>SpellCheckComponent</code> and many more.
+ See CHANGES.txt entries for full details.</p>
+</li>
+</ul>
+<h2 id="26_october_2011_-_java_7u1_fixes_index_corruption_and_crash_bugs_in_apache_lucene_core_and_apache_solrtitle">26 October 2011 - Java 7u1 fixes index corruption and crash bugs in Apache Lucene Core and Apache Solr</title></h2>
+<p>Oracle released <a href="http://www.oracle.com/technetwork/java/javase/7u1-relnotes-507962.html">Java 7u1</a> on October 19.
+ According to the release notes and tests done by the Lucene committers, all bugs reported on July 28 are fixed in this release,
+ so code using Porter stemmer no longer crashes with <code>SIGSEGV</code>. We were not able to experience any index corruption anymore,
+ so it is safe to use Java 7u1 with Lucene Core and Solr.
+ On the same day, Oracle released <a href="http://www.oracle.com/technetwork/java/javase/6u29-relnotes-507960.html">Java 6u29</a>
+ fixing the same problems occurring with Java 6, if the JVM switches <code>-XX:+AggressiveOpts</code>
+ or <code>-XX:+OptimizeStringConcat</code> were used. Of course, you should <strong>not</strong> use experimental JVM options like
+ <code>-XX:+AggressiveOpts</code> in production environments! We recommend everybody to upgrade to this latest version 6u29.
+ In case you upgrade to Java 7, remember that you may have to reindex, as the unicode
+ version shipped with Java 7 changed and tokenization behaves differently
+ (e.g. lowercasing). For more information, read <code>JRE_VERSION_MIGRATION.txt</code>
+ in your distribution package!</p>
+<h2 id="14_september_2011_-_lucene_core_340_and_solr_340_availabletitle">14 September 2011 - Lucene Core 3.4.0 and Solr 3.4.0 Available</title></h2>
+<div class="codehilite"><pre> The Lucene PMC is pleased to announce the availability of Apache Lucene 3.4.0 and Apache Solr 3.4.0.
+
+ Lucene can be downloaded from <span class="nt"><a</span> <span class="na">href=</span><span class="s">"http://www.apache.org/dyn/closer.cgi/lucene/java/"</span><span class="nt">></span>http://www.apache.org/dyn/closer.cgi/lucene/java/<span class="nt"></a></span> and Solr can be downloaded from <span class="nt"><a</span> <span class="na">href=</span><span class="s">"http://www.apache.org/dyn/closer.cgi/lucene/solr/"</span><span class="nt">></span>http://www.apache.org/dyn/closer.cgi/lucene/solr/<span class="nt"></a></span>
+</pre></div>
+
+
+<p>If you are already using Apache Lucene 3.1, 3.2 or 3.3, we strongly recommend you upgrade to 3.4.0 because of the index corruption bug on OS or computer crash or power loss (<a href="https://issues.apache.org/jira/browse/LUCENE-3418">LUCENE-3418</a>), now fixed in 3.4.0.</p>
+<p>Highlights of the Lucene release include:</p>
+<ul>
+<li>
+<p>Fixed a major bug (<a href="https://issues.apache.org/jira/browse/LUCENE-3418">LUCENE-3418</a>) whereby a Lucene index could
+easily become corrupted if the OS or computer crashed or lost
+power.</p>
+</li>
+<li>
+<p>Added a new faceting module (<code>contrib/facet</code>) for computing facet
+counts (both hierarchical and non-hierarchical) at search
+time (<a href="https://issues.apache.org/jira/browse/LUCENE-3079">LUCENE-3079</a>).</p>
+</li>
+<li>
+<p>Added a new join module (<code>contrib/join</code>), enabling indexing and
+searching of nested (parent/child) documents using
+<code>BlockJoinQuery</code>/<code>Collector</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3171">LUCENE-3171</a>).</p>
+</li>
+<li>
+<p>It is now possible to index documents with term frequencies
+included but without positions (<a href="https://issues.apache.org/jira/browse/LUCENE-2048">LUCENE-2048</a>); previously
+<code>omitTermFreqAndPositions</code> always omitted both.</p>
+</li>
+<li>
+<p>The modular <code>QueryParser</code> (<code>contrib/queryparser</code>) can now create
+<code>NumericRangeQuery</code>.</p>
+</li>
+<li>
+<p>Added SynonymFilter, in <code>contrib/analyzers</code>, to apply multi-word
+synonyms during indexing or querying, including parsers to read
+the wordnet and solr synonym formats (<a href="https://issues.apache.org/jira/browse/LUCENE-3233">LUCENE-3233</a>).</p>
+</li>
+<li>
+<p>You can now control how documents that don't have a value on the
+sort field should sort (<a href="https://issues.apache.org/jira/browse/LUCENE-3390">LUCENE-3390</a>), using <code>SortField.setMissingValue</code>.</p>
+</li>
+<li>
+<p>Fixed a case where term vectors could be silently deleted from the
+index after <code>addIndexes</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3402">LUCENE-3402</a>).</p>
+</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>
+<p>SolrJ client can now parse grouped and range facets results
+(<a href="https://issues.apache.org/jira/browse/SOLR-2523">SOLR-2523</a>).</p>
+</li>
+<li>
+<p>A new <code>XsltUpdateRequestHandler</code> allows posting XML that's
+transformed by a provided XSLT into a valid Solr document
+(<a href="https://issues.apache.org/jira/browse/SOLR-2630">SOLR-2630</a>).</p>
+</li>
+<li>
+<p>Post-group faceting option (<code>group.truncate</code>) can now compute
+facet counts for only the highest ranking documents per-group.
+(<a href="https://issues.apache.org/jira/browse/SOLR-2665">SOLR-2665</a>).</p>
+</li>
+<li>
+<p>Add <code>commitWithin</code> update request parameter to all update handlers
+that were previously missing it. This tells Solr to commit the
+change within the specified amount of time (<a href="https://issues.apache.org/jira/browse/SOLR-2540">SOLR-2540</a>).</p>
+</li>
+<li>
+<p>You can now specify <code>NIOFSDirectory</code> (<a href="https://issues.apache.org/jira/browse/SOLR-2670">SOLR-2670</a>).</p>
+</li>
+<li>
+<p>New parameter <code>hl.phraseLimit</code> speeds up <code>FastVectorHighlighter</code>
+(<a href="https://issues.apache.org/jira/browse/LUCENE-3234">LUCENE-3234</a>).</p>
+</li>
+<li>
+<p>The query cache and filter cache can now be disabled per request.
+See <a href="http://wiki.apache.org/solr/CommonQueryParameters#Caching_of_filters">this wiki page</a>
+(<a href="https://issues.apache.org/jira/browse/SOLR-2429">SOLR-2429</a>).</p>
+</li>
+<li>
+<p>Improved memory usage, build time, and performance of
+<code>SynonymFilterFactory</code> (<a href="https://issues.apache.org/jira/browse/LUCENE-3233">LUCENE-3233</a>).</p>
+</li>
+<li>
+<p>Added <code>omitPositions</code> to the schema, so you can omit position
+information while still indexing term frequencies (<a href="https://issues.apache.org/jira/browse/LUCENE-2048">LUCENE-2048</a>).</p>
+</li>
+<li>
+<p>Various fixes for multi-threaded <code>DataImportHandler</code>.</p>
+</li>
+</ul>
+<h2 id="28_july_2011_-_warning_index_corruption_and_crashes_in_apache_lucene_core__apache_solr_with_java_7">28 July 2011 - WARNING: Index corruption and crashes in Apache Lucene Core / Apache Solr with Java 7</h2>
+<p>Oracle released <a href="http://www.oracle.com/technetwork/java/javase/downloads/index.html">Java 7</a> today.
+Unfortunately it contains hotspot compiler optimizations, which miscompile some loops.
+This can affect code of several Apache projects. Sometimes JVMs only crash, but in several cases,
+results calculated can be incorrect, leading to bugs in applications
+(see Hotspot bugs <a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7070134">7070134</a>,
+<a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7044738">7044738</a>,
+<a href="http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7068051">7068051</a>).
+<strong>Apache Lucene Core</strong> and <strong>Apache Solr</strong> are two Apache projects,
+which are affected by these bugs, namely all versions released until today.
+Solr users with the default configuration will have
+Java crashing with <code>SIGSEGV</code> as soon as they start to index documents, as one
+affected part is the well-known Porter stemmer
+(see <a href="https://issues.apache.org/jira/browse/LUCENE-3335">LUCENE-3335</a>).
+Other loops in Lucene may be miscompiled, too, leading to index corruption
+(especially on Lucene trunk with pulsing codec; other loops may be
+affected, too - <a href="https://issues.apache.org/jira/browse/LUCENE-3346">LUCENE-3346</a>).
+These problems were detected only 5 days before the official Java 7 release,
+so Oracle had no time to fix those bugs, affecting also many more applications.
+In response to our questions, they proposed to include the fixes into service
+release u2 (eventually into service release u1, see
+<a href="http://mail.openjdk.java.net/pipermail/hotspot-compiler-dev/2011-July/005971.html">this mail</a>).
+<strong>This means you cannot use Apache Lucene/Solr with Java 7 releases before Update 2!</strong>
+If you do, please don't open bug reports, it is not the committers' fault!
+At least disable loop optimizations using the <code>-XX:-UseLoopPredicate</code> JVM option
+to not risk index corruptions.
+<em>Please note:</em> Also Java 6 users are affected, if they use one of those
+JVM options, which are <strong>not</strong> enabled by default: <code>-XX:+OptimizeStringConcat</code>
+or <code>-XX:+AggressiveOpts</code>.
+It is strongly recommended not to use any hotspot optimization switches in any Java
+version without extensive testing!
+In case you upgrade to Java 7, remember that you may have to reindex, as the unicode
+version shipped with Java 7 changed and tokenization behaves differently
+(e.g. lowercasing). For more information, read <code>JRE_VERSION_MIGRATION.txt</code>
+in your distribution package!</p>
+<h2 id="1_july_2011_-_lucene_core_33_and_solr_33_available">1 July 2011 - Lucene Core 3.3 and Solr 3.3 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.3 and Apache Solr 3.3.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>The spellchecker module now includes suggest/auto-complete functionality,
+ with three implementations: Jaspell, Ternary Trie, and Finite State.</li>
+<li>Support for merging results from multiple shards, for both "normal"
+ search results (TopDocs.merge) as well as grouped results using the
+ grouping module (SearchGroup.merge, TopGroups.merge).</li>
+<li>An optimized implementation of KStem, a less aggressive stemmer
+ for English</li>
+<li>Single-pass grouping implementation based on block document indexing.</li>
+<li>Improvements to MMapDirectory (now also the default implementation
+ returned by FSDirectory.open on 64-bit Linux).</li>
+<li>NRTManager simplifies handling near-real-time search with multiple
+ search threads, allowing the application to control which indexing
+ changes must be visible to which search requests.</li>
+<li>TwoPhaseCommitTool facilitates performing a multi-resource
+ two-phased commit, including IndexWriter.</li>
+<li>The default merge policy, TieredMergePolicy, has a new method
+ (set/getReclaimDeletesWeight) to control how aggressively it
+ targets segments with deletions, and is now more aggressive than
+ before by default.</li>
+<li>PKIndexSplitter tool splits an index by a mid-point term.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Grouping / Field Collapsing</li>
+<li>A new, automaton-based suggest/autocomplete implementation offering an
+ order of magnitude smaller RAM consumption.</li>
+<li>KStemFilterFactory, an optimized implementation of a less aggressive
+ stemmer for English.</li>
+<li>Solr defaults to a new, more efficient merge policy (TieredMergePolicy).
+ See <a href="http://s.apache.org/merging">http://s.apache.org/merging</a> for more information.</li>
+<li>Important bugfixes, including extremely high RAM usage in spellchecking.</li>
+<li>Bugfixes and improvements from Apache Lucene 3.3</li>
+</ul>
+<h2 id="4_june_2011_-_lucene_core_32_and_solr_32_available">4 June 2011 - Lucene Core 3.2 and Solr 3.2 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.2 and Apache Solr 3.2.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>A new grouping module, under lucene/contrib/grouping, enables
+ search results to be grouped by a single-valued indexed field</li>
+<li>A new IndexUpgrader tool fully converts an old index to the
+ current format.</li>
+<li>A new Directory implementation, NRTCachingDirectory, caches small
+ segments in RAM, to reduce the I/O load for applications with fast
+ NRT reopen rates.</li>
+<li>A new Collector implementation, CachingCollector, is able to
+ gather search hits (document IDs and optionally also scores) and
+ then replay them. This is useful for Collectors that require two
+ or more passes to produce results.</li>
+<li>Index a document block using IndexWriter's new addDocuments or
+ updateDocuments methods. These experimental APIs ensure that the
+ block of documents will forever remain contiguous in the index,
+ enabling interesting future features like grouping and joins.</li>
+<li>A new default merge policy, TieredMergePolicy, which is more
+ efficient due to being able to merge non-contiguous segments.
+ See <a href="http://s.apache.org/merging">http://s.apache.org/merging</a> for details.</li>
+<li>NumericField is now returned correctly when you load a stored
+ document (previously you received a normal Field back, with the
+ numeric value converted string).</li>
+<li>Deleted terms are now applied during flushing to the newly flushed
+ segment, which is more efficient than having to later initialize a
+ reader for that segment.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Ability to specify overwrite and commitWithin as request parameters when
+ using the JSON update format.</li>
+<li>TermQParserPlugin, useful when generating filter queries from terms
+ returned from field faceting or the terms component.</li>
+<li>DebugComponent now supports using a NamedList to model Explanation objects
+ in its responses instead of Explanation.toString.</li>
+<li>Improvements to the UIMA and Carrot2 integrations.</li>
+<li>Highlighting performance improvements. </li>
+<li>A test-framework jar for easy testing of Solr extensions.</li>
+<li>Bugfixes and improvements from Apache Lucene 3.2. </li>
+</ul>
+<h2 id="31_march_2011_-_lucene_core_31_and_solr_31_available">31 March 2011 - Lucene Core 3.1 and Solr 3.1 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability of Apache Lucene 3.1 and Apache Solr 3.1.
+The version number for Solr 3.1 was chosen to reflect the merge of
+development with Lucene, which is currently also on 3.1. Going
+forward, we expect the Solr version to be the same as the Lucene
+version. Solr 3.1 contains Lucene 3.1 and is the release after Solr 1.4.1.</p>
+<p>Lucene can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/java/">http://www.apache.org/dyn/closer.cgi/lucene/java/</a> and Solr can be downloaded from <a href="http://www.apache.org/dyn/closer.cgi/lucene/solr/">http://www.apache.org/dyn/closer.cgi/lucene/solr/</a>
+Highlights of the Lucene release include:</p>
+<ul>
+<li>Numerous performance improvements: faster exact PhraseQuery; merging
+favors segments with deletions; primary key lookup is faster;
+IndexWriter.addIndexes(Directory[]) uses file copy instead of
+merging; various Directory performance improvements; compound file
+is dynamically turned off for large segments; fully deleted segments
+are dropped on commit; faster snowball analyzers (in contrib);
+ConcurrentMergeScheduler is more careful about setting priority of
+merge threads.</li>
+<li>ReusableAnalyzerBase makes it easier to reuse TokenStreams
+correctly.</li>
+<li>Improved Analysis capabilities: Improved Unicode support, including
+Unicode 4, more friendly term handling (CharTermAttribute), easier
+object reuse and better support for protected words in lossy token
+filters (e.g. stemmers).</li>
+<li>ConstantScoreQuery now allows directly wrapping a Query.</li>
+<li>IndexWriter is now configured with a new separate builder API,
+IndexWriterConfig. You can now control IndexWriter's previously
+fixed internal thread limit by calling setMaxThreadStates.</li>
+<li>IndexWriter.getReader is replaced by IndexReader.open(IndexWriter).
+In addition you can now specify whether deletes should be resolved
+when you open an NRT reader.</li>
+<li>MultiSearcher is deprecated; ParallelMultiSearcher has been
+absorbed directly into IndexSearcher.</li>
+<li>On 64bit Windows and Solaris JVMs, MMapDirectory is now the
+default implementation (returned by FSDirectory.open).
+MMapDirectory also enables unmapping if the JVM supports it.</li>
+<li>New TotalHitCountCollector just counts total number of hits.</li>
+<li>ReaderFinishedListener API enables external caches to evict entries
+once a segment is finished.</li>
+</ul>
+<p>Highlights of the Solr release include:</p>
+<ul>
+<li>Numeric range facets (similar to date faceting).</li>
+<li>New spatial search, including spatial filtering, boosting and sorting capabilities.</li>
+<li>Example Velocity driven search UI at http://localhost:8983/solr/browse</li>
+<li>A new termvector-based highlighter</li>
+<li>Extend dismax (edismax) query parser which addresses some
+missing features in the dismax query parser along with some
+extensions.</li>
+<li>Several more components now support distributed mode:
+TermsComponent, SpellCheckComponent.</li>
+<li>A new Auto Suggest component.</li>
+<li>Ability to sort by functions.</li>
+<li>JSON document indexing.</li>
+<li>CSV response format.</li>
+<li>Apache UIMA integration for metadata extraction.</li>
+<li>Leverages Lucene 3.1 and it's inherent optimizations and bug fixes
+as well as new analysis capabilities.</li>
+<li>Numerous improvements, bug fixes, and optimizations.</li>
+</ul></div>
@@ -366,5 +756,4 @@ python2.3 instead of python2.4.</p>
</script>
</body>
-</html>