You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by bu...@apache.org on 2015/02/20 19:21:02 UTC

svn commit: r940869 - in /websites: production/lucene/content/ production/lucene/content/core/ production/lucene/content/solr/ staging/lucene/trunk/content/ staging/lucene/trunk/content/core/ staging/lucene/trunk/content/solr/

Author: buildbot
Date: Fri Feb 20 18:21:02 2015
New Revision: 940869

Log:
Dynamic update by buildbot for lucene

Modified:
    websites/production/lucene/content/core/index.html
    websites/production/lucene/content/index.html
    websites/production/lucene/content/solr/index.html
    websites/staging/lucene/trunk/content/core/index.html
    websites/staging/lucene/trunk/content/index.html
    websites/staging/lucene/trunk/content/solr/index.html

Modified: websites/production/lucene/content/core/index.html
==============================================================================
--- websites/production/lucene/content/core/index.html (original)
+++ websites/production/lucene/content/core/index.html Fri Feb 20 18:21:02 2015
@@ -305,6 +305,12 @@
       <div class="status-item">
       
       <div class="section-content">
+        <a class="svn" href="http://svn.apache.org/viewvc?revision=1661172;view=revision">r1661172</a>
+        <a href="https://issues.apache.org/jira/browse/LUCENE-6266">LUCENE-6266</a>: Remove unnecessary Directory parameters from SIS/SIPC/SI (<a href="http://lucene.apache.org/">lucene</a>) &mdash;
+        <a href="http://people.apache.org/committer-index.html#rmuir">rmuir</a>
+      </div>
+    
+      <div class="section-content">
         <a class="svn" href="http://svn.apache.org/viewvc?revision=1661156;view=revision">r1661156</a>
         <a href="https://issues.apache.org/jira/browse/LUCENE-6268">LUCENE-6268</a>: Replace FieldValueFilter and DocValuesRangeFilter with equivalent queries that support approximations.
  (<a href="http://lucene.apache.org/">lucene</a>) &mdash;
@@ -329,12 +335,6 @@
         <a href="https://issues.apache.org/jira/browse/LUCENE-6256">LUCENE-6256</a>: Change PostingsEnum.nextPosition() to consistently return -1 when positions are not available (<a href="http://lucene.apache.org/">lucene</a>) &mdash;
         <a href="http://people.apache.org/committer-index.html#rjernst">rjernst</a>
       </div>
-    
-      <div class="section-content">
-        <a class="svn" href="http://svn.apache.org/viewvc?revision=1660925;view=revision">r1660925</a>
-        <a href="https://issues.apache.org/jira/browse/SOLR-7125">SOLR-7125</a>: Add note to javadocs (<a href="http://lucene.apache.org/">lucene</a>) &mdash;
-        <a href="http://people.apache.org/committer-index.html#romseygeek">romseygeek</a>
-      </div>
     </div></div>
     
     

Modified: websites/production/lucene/content/index.html
==============================================================================
--- websites/production/lucene/content/index.html (original)
+++ websites/production/lucene/content/index.html Fri Feb 20 18:21:02 2015
@@ -204,6 +204,151 @@
 <li><a href="./pylucene/index.html">PyLucene</a> is a Python port of the Core project.</li>
 </ul>
 <div><h1 id="lucenewzxhzdk0tmwzxhzdk1-news">Lucene<span style="vertical-align: super; font-size: xx-small">TM</span> News</h1>
+<h2 id="20-february-2015-apache-lucene-500-and-apache-solr-500-available">20 February 2015 -Apache Lucene 5.0.0 and Apache Solr 5.0.0 Available</h2>
+<p>The Lucene PMC is pleased to announce the availability
+of Apache Lucene 5.0.0 and Apache Solr 5.0.0.</p>
+<p>Lucene can be downloaded from <a href="http://lucene.apache.org/core/mirrors-core-latest-redir.html">http://lucene.apache.org/core/mirrors-core-latest-redir.html</a>
+and Solr can be downloaded from <a href="http://lucene.apache.org/solr/mirrors-solr-latest-redir.html">http://lucene.apache.org/solr/mirrors-solr-latest-redir.html</a></p>
+<p>See the <a href="/core/5_0_0/changes/Changes.html">Lucene CHANGES.txt</a> and
+<a href="/solr/5_0_0/changes/Changes.html">Solr CHANGES.txt</a> files included
+with the release for a full list of details.</p>
+<h3 id="highlights-of-the-lucene-release-include">Highlights of the Lucene release include:</h3>
+<p>Stronger index safety
+* All file access now uses Java’s NIO.2 APIs which give Lucene stronger index safety in terms of better error handling and safer commits.</p>
+<ul>
+<li>
+<p>Every Lucene segment now stores a unique id per-segment and per-commit to aid in accurate replication of index files.</p>
+</li>
+<li>
+<p>During merging, IndexWriter now always checks the incoming segments for corruption before merging. This can mean, on upgrading to 5.0.0, that merging may uncover long-standing latent corruption in an older 4.x index.</p>
+</li>
+</ul>
+<p>Reduced heap usage
+* Lucene now supports random-writable and advance-able sparse bitsets (RoaringDocIdSet and SparseFixedBitSet), so the heap required is in proportion to how many bits are set, not how many total documents exist in the index.</p>
+<ul>
+<li>
+<p>Heap usage during IndexWriter merging is also much lower with the new Lucene50Codec, since doc values and norms for the segments being merged are no longer fully loaded into heap for all fields; now they are loaded for the one field currently being merged, and then dropped.</p>
+</li>
+<li>
+<p>The default norms format now uses sparse encoding when appropriate, so indices that enable norms for many sparse fields will see a large reduction in required heap at search time.</p>
+</li>
+<li>
+<p>5.0 has a new API to print a tree structure showing a recursive breakdown of which parts are using how much heap.</p>
+</li>
+</ul>
+<p>Other features
+* FieldCache is gone (moved to a dedicated UninvertingReader in the misc module). This means when you intend to sort on a field, you should index that field using doc values, which is much faster and less heap consuming than FieldCache.</p>
+<ul>
+<li>
+<p>Tokenizers and Analyzers no longer require Reader on init.</p>
+</li>
+<li>
+<p>NormsFormat now gets its own dedicated NormsConsumer/Producer</p>
+</li>
+<li>
+<p>SortedSetSortField, used to sort on a multi-valued field, is promoted from sandbox to Lucene's core.</p>
+</li>
+<li>
+<p>PostingsFormat now uses a "pull" API when writing postings, just like doc values. This is powerful because you can do things in your postings format that require making more than one pass through the postings such as iterating over all postings for each term to decide which compression format it should use.</p>
+</li>
+<li>
+<p>New DateRangeField type enables Indexing and searching of date ranges, particularly multi-valued ones.</p>
+</li>
+<li>
+<p>A new ExitableDirectoryReader extends FilterDirectoryReader and enables exiting requests that take too long to enumerate over terms.</p>
+</li>
+<li>
+<p>Suggesters from multi-valued field can now be built as DocumentDictionary now enumerates each value separately in a multi-valued field.</p>
+</li>
+<li>
+<p>ConcurrentMergeScheduler detects whether the index is on SSD or not and does a better job defaulting its settings. This only works on Linux for now; other OS's will continue to use the previous defaults (tuned for spinning disks).</p>
+</li>
+<li>
+<p>Auto-IO-throttling has been added to ConcurrentMergeScheduler, to rate limit IO writes for each merge depending on incoming merge rate.</p>
+</li>
+<li>
+<p>CustomAnalyzer has been added that allows to configure analyzers like you do in Solr's index schema. This class has a builder API to configure Tokenizers, TokenFilters, and CharFilters based on their SPI names and parameters as documented by the corresponding factories.</p>
+</li>
+<li>
+<p>Memory index now supports payloads.</p>
+</li>
+<li>
+<p>Added a filter cache with a usage tracking policy that caches filters based on frequency of use.</p>
+</li>
+<li>
+<p>The default codec has an option to control BEST_SPEED or BEST_COMPRESSION for stored fields.</p>
+</li>
+<li>
+<p>Stored fields are merged more efficiently, especially when upgrading from previous versions or using SortingMergePolicy</p>
+</li>
+</ul>
+<h3 id="highlights-of-the-solr-release-include">Highlights of the Solr release include:</h3>
+<ul>
+<li>
+<p>Usability improvements that include improved bin scripts and new and restructured examples.</p>
+</li>
+<li>
+<p>Scripts to support installing and running Solr as a service on Linux.</p>
+</li>
+<li>
+<p>Distributed IDF is now supported and can be enabled via the config. Currently, there are four supported implementations for the same:
+<strong> LocalStatsCache: Local document stats.
+</strong> ExactStatsCache: One time use aggregation
+<strong> ExactSharedStatsCache: Stats shared across requests
+</strong> LRUStatsCache: Stats shared in an LRU cache across requests</p>
+</li>
+<li>
+<p>Solr will no longer ship a war file and instead be a downloadable application.</p>
+</li>
+<li>
+<p>SolrJ now has first class support for Collections API.</p>
+</li>
+<li>
+<p>Implicit registration of replication,get and admin handlers.</p>
+</li>
+<li>
+<p>Config API that supports paramsets for easily configuring solr parameters and configuring fields. This API also supports managing of pre-existing request handlers and editing common solrconfig.xml via overlay.</p>
+</li>
+<li>
+<p>API for managing blobs allows uploading request handler jars and registering them via config API.</p>
+</li>
+<li>
+<p>BALANCESHARDUNIQUE Collection API that allows for even distribution of custom replica properties.</p>
+</li>
+<li>
+<p>There's now an option to not shuffle the nodeSet provided during collection creation.</p>
+</li>
+<li>
+<p>Option to configure bandwidth usage by Replication handler to prevent it from using up all the bandwidth.</p>
+</li>
+<li>
+<p>Splitting of clusterstate to per-collection enables scalability improvement in SolrCloud. This is also the default format for new Collections that would be created going forward.</p>
+</li>
+<li>
+<p>timeAllowed is now used to prematurely terminate requests during query expansion and SolrClient request retry.</p>
+</li>
+<li>
+<p>pivot.facet results can now include nested stats.field results constrained by those pivots.</p>
+</li>
+<li>
+<p>stats.field can be used to generate stats over the results of arbitrary numeric functions.
+  It also allows for requesting for statistics for pivot facets using tags.</p>
+</li>
+<li>
+<p>A new DateRangeField has been added for indexing date ranges, especially multi-valued ones.</p>
+</li>
+<li>
+<p>Spatial fields that used to require units=degrees now take distanceUnits=degrees/kilometers miles instead.</p>
+</li>
+<li>
+<p>MoreLikeThis query parser allows requesting for documents similar to an existing document and also works in SolrCloud mode.</p>
+</li>
+<li>
+<p>Logging improvements:
+<strong> Transaction log replay status is now logged
+</strong> Optional logging of slow requests.</p>
+</li>
+</ul>
 <h2 id="29-december-2014-apache-lucene-4103-and-apache-solr-4103-available">29 December 2014 - Apache Lucene 4.10.3 and Apache Solr 4.10.3 Available</h2>
 <p>The Lucene PMC is pleased to announce the availability
 of Apache Lucene 4.10.3 and Apache Solr 4.10.3.</p>
@@ -249,7 +394,7 @@ and Solr can be downloaded from <a href=
 <p>See the <a href="/core/4_10_0/changes/Changes.html">Lucene CHANGES.txt</a> and
 <a href="/solr/4_10_0/changes/Changes.html">Solr CHANGES.txt</a> files included
 with the release for a full list of details.</p>
-<h3 id="highlights-of-the-lucene-release-include">Highlights of the Lucene release include:</h3>
+<h3 id="highlights-of-the-lucene-release-include_1">Highlights of the Lucene release include:</h3>
 <ul>
 <li>
 <p>New TermAutomatonQuery using an automaton for proximity queries.
@@ -268,7 +413,7 @@ with the release for a full list of deta
 <p>Fixed edge case in StandardTokenizer that caused extremely slow parsing times with long text which partially matched grammar rules.</p>
 </li>
 </ul>
-<h3 id="highlights-of-the-solr-release-include">Highlights of the Solr release include:</h3>
+<h3 id="highlights-of-the-solr-release-include_1">Highlights of the Solr release include:</h3>
 <ul>
 <li>
 <p>This release upgrades Solr Cell's (contrib/extraction) dependency
@@ -309,7 +454,7 @@ and Solr can be downloaded from <a href=
 <p>See the <a href="/core/4_9_0/changes/Changes.html">Lucene CHANGES.txt</a> and
 <a href="/solr/4_9_0/changes/Changes.html">Solr CHANGES.txt</a> files included
 with the release for a full list of details.</p>
-<h3 id="highlights-of-the-lucene-release-include_1">Highlights of the Lucene release include:</h3>
+<h3 id="highlights-of-the-lucene-release-include_2">Highlights of the Lucene release include:</h3>
 <ul>
 <li>
 <p>New Terms.getMin/Max methods to retrieve the lowest and highest
@@ -352,7 +497,7 @@ with the release for a full list of deta
   a new map.</p>
 </li>
 </ul>
-<h3 id="highlights-of-the-solr-release-include_1">Highlights of the Solr release include:</h3>
+<h3 id="highlights-of-the-solr-release-include_2">Highlights of the Solr release include:</h3>
 <ul>
 <li>
 <p>Numerous optimizations for doc values search-time performance</p>
@@ -399,7 +544,7 @@ both are fully compatible with Java 8.</
 <p>See the <a href="/core/4_8_0/changes/Changes.html">Lucene CHANGES.txt</a> and
 <a href="/solr/4_8_0/changes/Changes.html">Solr CHANGES.txt</a> files included
 with the release for a full list of details.</p>
-<h3 id="highlights-of-the-lucene-release-include_2">Highlights of the Lucene release include:</h3>
+<h3 id="highlights-of-the-lucene-release-include_3">Highlights of the Lucene release include:</h3>
 <ul>
 <li>
 <p>All index files now store end-to-end checksums, which are
@@ -452,7 +597,7 @@ with the release for a full list of deta
   even when the lock is not held.</p>
 </li>
 </ul>
-<h3 id="highlights-of-the-solr-release-include_2">Highlights of the Solr release include:</h3>
+<h3 id="highlights-of-the-solr-release-include_3">Highlights of the Solr release include:</h3>
 <ul>
 <li>
 <p><code class="inline">&lt;fields&gt;</code> and <code class="inline">&lt;types&gt;</code> tags have been deprecated from schema.xml.
@@ -582,7 +727,7 @@ and Solr can be downloaded from <a href=
 <p>See the <a href="/core/4_5_0/changes/Changes.html">Lucene CHANGES.txt</a> and
 <a href="/solr/4_5_0/changes/Changes.html">Solr CHANGES.txt</a> files included
 with the release for a full list of details.</p>
-<h3 id="highlights-of-the-lucene-release-include_3">Highlights of the Lucene release include:</h3>
+<h3 id="highlights-of-the-lucene-release-include_4">Highlights of the Lucene release include:</h3>
 <ul>
 <li>
 <p>Added support for missing values to DocValues fields through
@@ -608,7 +753,7 @@ with the release for a full list of deta
 </li>
 </ul>
 <p>Lucene 4.5 also includes numerous optimizations and bugfixes.</p>
-<h3 id="highlights-of-the-solr-release-include_3">Highlights of the Solr release include:</h3>
+<h3 id="highlights-of-the-solr-release-include_4">Highlights of the Solr release include:</h3>
 <ul>
 <li>
 <p>Custom sharding support, including the ability to shard by field.</p>

Modified: websites/production/lucene/content/solr/index.html
==============================================================================
    (empty)

Modified: websites/staging/lucene/trunk/content/core/index.html
==============================================================================
    (empty)

Modified: websites/staging/lucene/trunk/content/index.html
==============================================================================
    (empty)

Modified: websites/staging/lucene/trunk/content/solr/index.html
==============================================================================
    (empty)