You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by ho...@apache.org on 2012/07/31 03:37:18 UTC
svn commit: r1367384 - in /lucene/dev/trunk/solr: CHANGES.txt
contrib/extraction/CHANGES.txt contrib/extraction/README.txt
contrib/uima/CHANGES.txt contrib/uima/README.txt
Author: hossman
Date: Tue Jul 31 01:37:17 2012
New Revision: 1367384
URL: http://svn.apache.org/viewvc?rev=1367384&view=rev
Log:
SOLR-3650: checkpoint, migrated CHANGES.txt for contrib/uima and contrib/extraction
Added:
lucene/dev/trunk/solr/contrib/extraction/README.txt
- copied, changed from r1367376, lucene/dev/trunk/solr/contrib/extraction/CHANGES.txt
Removed:
lucene/dev/trunk/solr/contrib/extraction/CHANGES.txt
lucene/dev/trunk/solr/contrib/uima/CHANGES.txt
Modified:
lucene/dev/trunk/solr/CHANGES.txt
lucene/dev/trunk/solr/contrib/uima/README.txt
Modified: lucene/dev/trunk/solr/CHANGES.txt
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/solr/CHANGES.txt?rev=1367384&r1=1367383&r2=1367384&view=diff
==============================================================================
--- lucene/dev/trunk/solr/CHANGES.txt (original)
+++ lucene/dev/trunk/solr/CHANGES.txt Tue Jul 31 01:37:17 2012
@@ -1045,6 +1045,11 @@ New Features
support numeric collation, ignore punctuation/whitespace, ignore accents but
not case, control whether upper/lowercase values are sorted first, etc. (rmuir)
+* SOLR-2346: Add a chance to set content encoding explicitly via content type
+ of stream for extracting request handler. This is convenient when Tika's
+ auto detector cannot detect encoding, especially the text file is too short
+ to detect encoding. (koji)
+
Optimizations
----------------------
* SOLR-1931: Speedup for LukeRequestHandler and admin/schema browser. New parameter
@@ -1286,6 +1291,12 @@ Other Changes
repository). Also updated dependencies jackson-core-asl and
jackson-mapper-asl (both v1.5.2 -> v1.7.4). (Dawid Weiss, Steve Rowe)
+* SOLR-3295: netcdf jar is excluded from the binary release (and disabled in
+ ivy.xml) because it requires java 6. If you want to parse this content with
+ extracting request handler and are willing to use java 6, just add the jar.
+ (rmuir)
+
+
Build
----------------------
* SOLR-2487: Add build target to package war without slf4j jars (janhoy)
@@ -1419,6 +1430,9 @@ Bug Fixes
* SOLR-2591: Remove commitLockTimeout option from solrconfig.xml (Luca Cavanna via Martijn van Groningen)
+* SOLR-2746: Upgraded UIMA dependencies from *-2.3.1-SNAPSHOT.jar to *-2.3.1.jar.
+
+
================== 3.4.0 ==================
Upgrading from Solr 3.3
@@ -1577,6 +1591,9 @@ Bug Fixes
* SOLR-2629: Eliminate deprecation warnings in some JSPs.
(Bernd Fehling, hossman)
+* SOLR-2743: Remove commons logging from contrib/extraction. (koji)
+
+
Build
----------------------
@@ -1648,6 +1665,13 @@ New Features
* SOLR-2610 -- Add an option to delete index through CoreAdmin UNLOAD action (shalin)
+* SOLR-2480: Add ignoreTikaException flag to the extraction request handler so
+ that users can ignore TikaException but index meta data.
+ (Shinichiro Abe, koji)
+
+* SOLR-2582: Use uniqueKey for error log in UIMAUpdateRequestProcessor.
+ (Tommaso Teofili via koji)
+
Optimizations
----------------------
@@ -1667,6 +1691,12 @@ Bug Fixes
parameter is added to avoid excessive CPU time in extreme cases (e.g. long
queries with many misspelled words). (James Dyer via rmuir)
+* SOLR-2579: UIMAUpdateRequestProcessor ignore error fails if text.length() < 100.
+ (Elmer Garduno via koji)
+
+* SOLR-2581: UIMAToSolrMapper wrongly instantiates Type with reflection.
+ (Tommaso Teofili via koji)
+
Other Changes
----------------------
@@ -1706,6 +1736,10 @@ Upgrading from Solr 3.1
with update.chain rather than update.processor. The latter still works,
but has been deprecated.
+* <uimaConfig/> just beneath <config> ... </config> is no longer supported.
+ It should move to UIMAUpdateRequestProcessorFactory setting.
+ See contrib/uima/README.txt for more details. (SOLR-2436)
+
Detailed Change List
----------------------
@@ -1732,6 +1766,12 @@ New Features
for clustering (SOLR-2450), output of cluster scores (SOLR-2505)
(Stanislaw Osinski, Dawid Weiss).
+* SOLR-2503: extend UIMAUpdateRequestProcessorFactory mapping function to
+ map feature value to dynamicField. (koji)
+
+* SOLR-2512: add ignoreErrors flag to UIMAUpdateRequestProcessorFactory so
+ that users can ignore exceptions in AE. (Tommaso Teofili, koji)
+
Optimizations
----------------------
@@ -1818,6 +1858,12 @@ Other Changes
* SOLR-2528: Remove default="true" from HtmlEncoder in example solrconfig.xml,
because html encoding confuses non-ascii users. (koji)
+* SOLR-2387: add mock annotators for improved testing in contrib/uima,
+ (Tommaso Teofili via rmuir)
+
+* SOLR-2436: move uimaConfig to under the uima's update processor in
+ solrconfig.xml. (Tommaso Teofili, koji)
+
Build
----------------------
@@ -2377,6 +2423,12 @@ Bug Fixes
* SOLR-1692: Fix bug in clustering component relating to carrot.produceSummary
option (gsingers)
+* SOLR-1756: The date.format setting for extraction request handler causes
+ ClassCastException when enabled and the config code that parses this setting
+ does not properly use the same iterator instance.
+ (Christoph Brill, Mark Miller)
+
+
Other Changes
----------------------
@@ -2504,6 +2556,10 @@ Other Changes
* SOLR-141: Errors and Exceptions are formated by ResponseWriter.
(Mike Sokolov, Rich Cariens, Daniel Naber, ryan)
+* SOLR-1902: Upgraded to Tika 0.8 and changed deprecated parse call
+
+* SOLR-1813: Add ICU4j to contrib/extraction libs and add tests for Arabic
+ extraction (Robert Muir via gsingers)
Build
----------------------
@@ -2874,6 +2930,11 @@ New Features
84. SOLR-1449: Add <lib> elements to solrconfig.xml to specifying additional
classpath directories and regular expressions. (hossman via yonik)
+85. SOLR-1128: Added metadata output to extraction request handler "extract
+ only" option. (gsingers)
+
+86. SOLR-1274: Added text serialization output for extractOnly
+ (Peter Wolanin, gsingers)
Optimizations
----------------------
@@ -3288,6 +3349,14 @@ Other Changes
50. SOLR-1357 SolrInputDocument cannot process dynamic fields (Lars Grote via noble)
+51. SOLR-1075: Upgrade to Tika 0.3. See http://www.apache.org/dist/lucene/tika/CHANGES-0.3.txt (gsingers)
+
+52. SOLR-1310: Upgrade to Tika 0.4. Note there are some differences in
+ detecting Languages now in extracting request handler.
+ See http://www.lucidimagination.com/search/document/d6f1899a85b2a45c/vote_apache_tika_0_4_release_candidate_2#d6f1899a85b2a45c
+ for discussion on language detection.
+ See http://www.apache.org/dist/lucene/tika/CHANGES-0.4.txt. (gsingers)
+
Build
----------------------
1. SOLR-776: Added in ability to sign artifacts via Ant for releases (gsingers)
Copied: lucene/dev/trunk/solr/contrib/extraction/README.txt (from r1367376, lucene/dev/trunk/solr/contrib/extraction/CHANGES.txt)
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/solr/contrib/extraction/README.txt?p2=lucene/dev/trunk/solr/contrib/extraction/README.txt&p1=lucene/dev/trunk/solr/contrib/extraction/CHANGES.txt&r1=1367376&r2=1367384&rev=1367384&view=diff
==============================================================================
--- lucene/dev/trunk/solr/contrib/extraction/CHANGES.txt (original)
+++ lucene/dev/trunk/solr/contrib/extraction/README.txt Tue Jul 31 01:37:17 2012
@@ -1,7 +1,4 @@
Apache Solr Content Extraction Library (Solr Cell)
- Release Notes
-
-This file describes changes to the Solr Cell (contrib/extraction) module. See SOLR-284 for details.
Introduction
------------
@@ -17,81 +14,3 @@ You will need Solr up and running. Then
to your Solr Home lib directory. See http://wiki.apache.org/solr/ExtractingRequestHandler for more details on hooking it in
and configuring.
-Tika Dependency
----------------
-
-Current Version: Tika 1.1 (released 2012-03-23)
-
-$Id$
-
-================== Release 5.0.0 ==============
-
- (No changes)
-
-================== Release 4.0.0-ALPHA ==============
-
-* SOLR-3254: Upgrade Solr to Tika 1.1 (janhoy)
-
-================== Release 3.6.1 ==================
-
-(No Changes)
-
-================== Release 3.6.0 ==================
-
-* SOLR-2346: Add a chance to set content encoding explicitly via content type of stream.
- This is convenient when Tika's auto detector cannot detect encoding, especially
- the text file is too short to detect encoding. (koji)
-
-* SOLR-2901: Upgrade Solr to Tika 1.0 (janhoy)
-
-* SOLR-3295: netcdf jar is excluded from the binary release (and disabled in ivy.xml)
- because it requires java 6. If you want to parse this content and are willing to
- use java 6, just add the jar. (rmuir)
-
-================== Release 3.5.0 ==================
-
-* SOLR-2372: Upgrade Solr to Tika 0.10 (janhoy)
-
-================== Release 3.4.0 ==================
-
-* SOLR-2540: CommitWithin as an Update Request parameter
- You can now specify &commitWithin=N (ms) on the update request (janhoy)
-
-* SOLR-2743: Remove commons logging. (koji)
-
-================== Release 3.3.0 ==================
-
-(No Changes)
-
-================== Release 3.2.0 ==================
-
-* SOLR-2480: Add ignoreTikaException flag so that users can ignore TikaException but index
- meta data. (Shinichiro Abe, koji)
-
-================== Release 3.1.0 ==================
-
-* SOLR-1902: Upgraded to Tika 0.8 and changed deprecated parse call
-
-* SOLR-1756: The date.format setting causes ClassCastException when enabled and the config code that
- parses this setting does not properly use the same iterator instance. (Christoph Brill, Mark Miller)
-
-* SOLR-18913: Add ICU4j to libs and add tests for Arabic extraction (Robert Muir via gsingers)
-
-* SOLR-1902: Upgraded to Tika 0.8-SNAPSHOT to incorporate passing in Solr's custom ClassLoader (gsingers)
-
-================== Release 1.4.0 ==================
-
-1. SOLR-284: Added in support for extraction. (Eric Pugh, Chris Harris, gsingers)
-
-2. SOLR-284: Removed "silent success" key generation (gsingers)
-
-3. SOLR-1075: Upgrade to Tika 0.3. See http://www.apache.org/dist/lucene/tika/CHANGES-0.3.txt (gsingers)
-
-4. SOLR-1128: Added metadata output to "extract only" option. (gsingers)
-
-5. SOLR-1310: Upgrade to Tika 0.4. Note there are some differences in detecting Languages now.
- See http://www.lucidimagination.com/search/document/d6f1899a85b2a45c/vote_apache_tika_0_4_release_candidate_2#d6f1899a85b2a45c
- for discussion on language detection.
- See http://www.apache.org/dist/lucene/tika/CHANGES-0.4.txt. (gsingers)
-
-6. SOLR-1274: Added text serialization output for extractOnly (Peter Wolanin, gsingers)
Modified: lucene/dev/trunk/solr/contrib/uima/README.txt
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/solr/contrib/uima/README.txt?rev=1367384&r1=1367383&r2=1367384&view=diff
==============================================================================
--- lucene/dev/trunk/solr/contrib/uima/README.txt (original)
+++ lucene/dev/trunk/solr/contrib/uima/README.txt Tue Jul 31 01:37:17 2012
@@ -1,3 +1,15 @@
+Apache Solr UIMA Metadata Extraction Library
+
+Introduction
+------------
+This module is intended to be used both as an UpdateRequestProcessor while indexing documents and as a set of tokenizer/filters
+to be configured inside the schema.xml for use during analysis phase.
+UIMAUpdateRequestProcessor purpose is to provide additional on the fly automatically generated fields to the Solr index.
+Such fields could be language, concepts, keywords, sentences, named entities, etc.
+UIMA based tokenizers/filters can be used either inside plain Lucene or as index/query analyzers to be defined
+inside the schema.xml of a Solr core to create/filter tokens using specific UIMA annotations.
+
+
Getting Started
---------------
To start using Solr UIMA Metadata Extraction Library you should go through the following configuration steps: