You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by rm...@apache.org on 2012/04/21 20:01:10 UTC
svn commit: r1328717 - in
/lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene:
analysis/charfilter/ analysis/cjk/ analysis/core/ analysis/standard/
analysis/standard/std31/ analysis/standard/std34/ collation/
collation/tokenattributes/
Author: rmuir
Date: Sat Apr 21 18:01:10 2012
New Revision: 1328717
URL: http://svn.apache.org/viewvc?rev=1328717&view=rev
Log:
some package.html cleanup in analysis/common
Added:
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/package.html (with props)
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/std31/package.html (props changed)
- copied unchanged from r1328715, lucene/dev/branches/lucene_solr_3_6/lucene/core/src/java/org/apache/lucene/analysis/standard/std31/package.html
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/std34/package.html (props changed)
- copied unchanged from r1328715, lucene/dev/branches/lucene_solr_3_6/lucene/core/src/java/org/apache/lucene/analysis/standard/std34/package.html
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/tokenattributes/package.html (with props)
Modified:
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/charfilter/package.html
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/cjk/package.html
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/package.html
lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/package.html
Modified: lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/charfilter/package.html
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/charfilter/package.html?rev=1328717&r1=1328716&r2=1328717&view=diff
==============================================================================
--- lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/charfilter/package.html (original)
+++ lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/charfilter/package.html Sat Apr 21 18:01:10 2012
@@ -18,9 +18,12 @@
<html><head></head>
<body>
<p>
- Chainable filters that normalize text before tokenization and provide
- mappings between normalized text offsets and the corresponding offset
- in the original text.
+Normalization of text before the tokenizer.
+</p>
+<p>
+ CharFilters are chainable filters that normalize text before tokenization
+ and provide mappings between normalized text offsets and the corresponding
+ offset in the original text.
</p>
<H2>CharFilter offset mappings</H2>
<p>
Modified: lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/cjk/package.html
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/cjk/package.html?rev=1328717&r1=1328716&r2=1328717&view=diff
==============================================================================
--- lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/cjk/package.html (original)
+++ lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/cjk/package.html Sat Apr 21 18:01:10 2012
@@ -20,7 +20,8 @@
<META http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
-Analyzer for Chinese, Japanese, and Korean, which indexes bigrams (overlapping groups of two adjacent Han characters).
+Analyzer for Chinese, Japanese, and Korean, which indexes bigrams.
+This analyzer generates bigram terms, which are overlapping groups of two adjacent Han, Hiragana, Katakana, or Hangul characters.
<p>
Three analyzers are provided for Chinese, each of which treats Chinese text in a different way.
<ul>
Added: lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/package.html
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/package.html?rev=1328717&view=auto
==============================================================================
--- lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/package.html (added)
+++ lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/package.html Sat Apr 21 18:01:10 2012
@@ -0,0 +1,22 @@
+<!doctype html public "-//w3c//dtd html 4.0 transitional//en">
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+<html><head></head>
+<body>
+Basic, general-purpose analysis components.
+</body>
+</html>
Modified: lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/package.html
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/package.html?rev=1328717&r1=1328716&r2=1328717&view=diff
==============================================================================
--- lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/package.html (original)
+++ lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/package.html Sat Apr 21 18:01:10 2012
@@ -20,6 +20,9 @@
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
</head>
<body>
+<p>
+Fast, general-purpose grammar-based tokenizers.
+</p>
<p>The <code>org.apache.lucene.analysis.standard</code> package contains three
fast grammar-based tokenizers constructed with JFlex:</p>
<ul>
Modified: lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/package.html
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/package.html?rev=1328717&r1=1328716&r2=1328717&view=diff
==============================================================================
--- lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/package.html (original)
+++ lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/package.html Sat Apr 21 18:01:10 2012
@@ -21,12 +21,10 @@
</head>
<body>
<p>
- <code>CollationKeyFilter</code>
+ Unicode collation support.
+ <code>Collation</code>
converts each token into its binary <code>CollationKey</code> using the
- provided <code>Collator</code>, and then encode the <code>CollationKey</code>
- as a String using
- {@link org.apache.lucene.util.IndexableBinaryStringTools}, to allow it to be
- stored as an index term.
+ provided <code>Collator</code>, allowing it to be stored as an index term.
</p>
<h2>Use Cases</h2>
Added: lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/tokenattributes/package.html
URL: http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/tokenattributes/package.html?rev=1328717&view=auto
==============================================================================
--- lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/tokenattributes/package.html (added)
+++ lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/collation/tokenattributes/package.html Sat Apr 21 18:01:10 2012
@@ -0,0 +1,22 @@
+<!doctype html public "-//w3c//dtd html 4.0 transitional//en">
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+<html>
+<body>
+Custom {@link org.apache.lucene.util.AttributeImpl} for indexing collation keys as index terms.
+</body>
+</html>
\ No newline at end of file