You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@uima.apache.org by re...@apache.org on 2020/09/07 10:04:16 UTC
[uima-uimafit] 01/01: [UIMA-6264] Switch from DocBook to Asciidoc
This is an automated email from the ASF dual-hosted git repository.
rec pushed a commit to branch UIMA-6264-Switch-from-DocBook-to-Asciidoc
in repository https://gitbox.apache.org/repos/asf/uima-uimafit.git
commit bf31d7970dda77a68762ebf06de889e62fd1680b
Author: Richard Eckart de Castilho <re...@apache.org>
AuthorDate: Mon Sep 7 12:04:05 2020 +0200
[UIMA-6264] Switch from DocBook to Asciidoc
- Added new doc module
- Converted docbook XML files to Asciidoc
- Removed dockbook module
- Changed release assembly to obtain the documentation from the doc module
- Fixed a few typos in the converted documentation
---
pom.xml | 2 +-
src/main/assembly/bin.xml | 4 +-
uimafit-doc/pom.xml | 150 ++++++++++
.../src/main/asciidoc/common_book_info.adoc | 38 +++
.../src/main/asciidoc/tools.uimafit.book.adoc | 46 +++
.../src/main/asciidoc/tools.uimafit.casutil.adoc | 83 ++++++
.../tools.uimafit.configurationparameters.adoc | 141 +++++++++
.../main/asciidoc/tools.uimafit.experiments.adoc | 41 +++
.../asciidoc/tools.uimafit.externalresources.adoc | 288 ++++++++++++++++++
.../asciidoc/tools.uimafit.gettingstarted.adoc | 147 ++++++++++
.../main/asciidoc/tools.uimafit.introduction.adoc | 122 ++++++++
.../src/main/asciidoc/tools.uimafit.maven.adoc | 195 +++++++++++++
.../src/main/asciidoc/tools.uimafit.migration.adoc | 189 ++++++++++++
.../src/main/asciidoc/tools.uimafit.packaging.adoc | 102 +++++++
.../src/main/asciidoc/tools.uimafit.pipelines.adoc | 72 +++++
.../main/asciidoc/tools.uimafit.typesystem.adoc | 174 +++++++++++
uimafit-docbook/pom.xml | 36 ---
uimafit-docbook/src/docbook/common_book_info.xml | 79 -----
uimafit-docbook/src/docbook/tools.uimafit.book.xml | 49 ----
.../src/docbook/tools.uimafit.casutil.xml | 122 --------
.../tools.uimafit.configurationparameters.xml | 185 ------------
.../src/docbook/tools.uimafit.experiments.xml | 60 ----
.../docbook/tools.uimafit.externalresources.xml | 321 ---------------------
.../src/docbook/tools.uimafit.gettingstarted.xml | 141 ---------
.../src/docbook/tools.uimafit.introduction.xml | 162 -----------
.../src/docbook/tools.uimafit.maven.xml | 190 ------------
.../src/docbook/tools.uimafit.migration.xml | 226 ---------------
.../src/docbook/tools.uimafit.packaging.xml | 105 -------
.../src/docbook/tools.uimafit.pipelines.xml | 73 -----
.../src/docbook/tools.uimafit.testing.xml | 105 -------
.../src/docbook/tools.uimafit.typesystem.xml | 163 -----------
31 files changed, 1791 insertions(+), 2020 deletions(-)
diff --git a/pom.xml b/pom.xml
index ea84744..38243e3 100644
--- a/pom.xml
+++ b/pom.xml
@@ -128,7 +128,7 @@
<module>uimafit-spring</module>
<module>uimafit-maven-plugin</module>
<module>uimafit-legacy-support</module>
- <module>uimafit-docbook</module>
+ <module>uimafit-doc</module>
<module>uimafit-cpe</module>
<module>uimafit-benchmark</module>
<module>uimafit-parent</module>
diff --git a/src/main/assembly/bin.xml b/src/main/assembly/bin.xml
index fa4aa47..066cb11 100644
--- a/src/main/assembly/bin.xml
+++ b/src/main/assembly/bin.xml
@@ -129,9 +129,9 @@
<directoryMode>755</directoryMode>
</fileSet>
- <!-- docbooks -->
+ <!-- manuals -->
<fileSet>
- <directory>uimafit-docbook/target/site/</directory>
+ <directory>uimafit-doc/target/site/</directory>
<outputDirectory>docs</outputDirectory>
<fileMode>644</fileMode>
<directoryMode>755</directoryMode>
diff --git a/uimafit-doc/pom.xml b/uimafit-doc/pom.xml
new file mode 100644
index 0000000..e044c7a
--- /dev/null
+++ b/uimafit-doc/pom.xml
@@ -0,0 +1,150 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one
+ or more contributor license agreements. See the NOTICE file
+ distributed with this work for additional information
+ regarding copyright ownership. The ASF licenses this file
+ to you under the Apache License, Version 2.0 (the
+ "License"); you may not use this file except in compliance
+ with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing,
+ software distributed under the License is distributed on an
+ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ KIND, either express or implied. See the License for the
+ specific language governing permissions and limitations
+ under the License.
+-->
+<project xmlns="http://maven.apache.org/POM/4.0.0"
+ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
+ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
+ <modelVersion>4.0.0</modelVersion>
+ <parent>
+ <groupId>org.apache.uima</groupId>
+ <artifactId>uimafit-parent</artifactId>
+ <version>2.5.1-SNAPSHOT</version>
+ <relativePath>../uimafit-parent</relativePath>
+ </parent>
+ <artifactId>uimafit-doc</artifactId>
+ <name>Apache UIMA uimaFIT - Documentation</name>
+ <packaging>pom</packaging>
+ <properties>
+ <asciidoctor.plugin.version>1.6.0</asciidoctor.plugin.version>
+ <asciidoctor.version>1.6.2</asciidoctor.version>
+ <asciidoctor.pdf.version>1.5.3</asciidoctor.pdf.version>
+ <maven.deploy.skip>true</maven.deploy.skip>
+ </properties>
+ <build>
+ <plugins>
+ <plugin>
+ <groupId>org.asciidoctor</groupId>
+ <artifactId>asciidoctor-maven-plugin</artifactId>
+ <version>${asciidoctor.plugin.version}</version>
+ <executions>
+ <execution>
+ <id>user-guide-html</id>
+ <phase>generate-resources</phase>
+ <goals>
+ <goal>process-asciidoc</goal>
+ </goals>
+ <configuration>
+ <backend>html5</backend>
+ <attributes>
+ <toc>left</toc>
+ </attributes>
+ </configuration>
+ </execution>
+ <execution>
+ <id>user-guide-pdf</id>
+ <phase>generate-resources</phase>
+ <goals>
+ <goal>process-asciidoc</goal>
+ </goals>
+ <configuration>
+ <backend>pdf</backend>
+ <attributes>
+ <toc>preamble</toc>
+ </attributes>
+ </configuration>
+ </execution>
+ </executions>
+ <configuration>
+ <sourceDocumentName>tools.uimafit.book.adoc</sourceDocumentName>
+ <outputDirectory>${project.build.directory}/site/d</outputDirectory>
+ <attributes>
+ <doctype>book</doctype>
+ <toclevels>8</toclevels>
+ <sectanchors>true</sectanchors>
+ <docinfo1>true</docinfo1>
+ <project-version>${project.version}</project-version>
+ <revnumber>${project.version}</revnumber>
+ <product-name>Apache UIMA uimaFIT</product-name>
+ <product-website-url>https://uima.apache.org/uimafit.html</product-website-url>
+ <icons>font</icons>
+ </attributes>
+ <requires>
+ <require>asciidoctor-pdf</require>
+ </requires>
+ </configuration>
+ <dependencies>
+ <dependency>
+ <groupId>org.asciidoctor</groupId>
+ <artifactId>asciidoctorj</artifactId>
+ <version>${asciidoctor.version}</version>
+ </dependency>
+ <dependency>
+ <groupId>org.asciidoctor</groupId>
+ <artifactId>asciidoctorj-pdf</artifactId>
+ <version>${asciidoctor.pdf.version}</version>
+ </dependency>
+ </dependencies>
+ </plugin>
+ </plugins>
+ </build>
+ <profiles>
+ <profile>
+ <id>m2e</id>
+ <activation>
+ <property>
+ <name>m2e.version</name>
+ </property>
+ </activation>
+ <build>
+ <pluginManagement>
+ <plugins>
+ <!--
+ - This plugin's configuration is used to store Eclipse m2e settings only.
+ - It has no influence on the Maven build itself.
+ -->
+ <plugin>
+ <groupId>org.eclipse.m2e</groupId>
+ <artifactId>lifecycle-mapping</artifactId>
+ <version>1.0.0</version>
+ <configuration>
+ <lifecycleMappingMetadata>
+ <pluginExecutions>
+ <pluginExecution>
+ <pluginExecutionFilter>
+ <groupId>org.asciidoctor</groupId>
+ <artifactId>asciidoctor-maven-plugin</artifactId>
+ <versionRange>[1.0,)</versionRange>
+ <goals>
+ <goal>process-asciidoc</goal>
+ </goals>
+ </pluginExecutionFilter>
+ <action>
+ <execute />
+ </action>
+ </pluginExecution>
+ </pluginExecutions>
+ </lifecycleMappingMetadata>
+ </configuration>
+ </plugin>
+ </plugins>
+ </pluginManagement>
+ </build>
+ </profile>
+ </profiles>
+</project>
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/common_book_info.adoc b/uimafit-doc/src/main/asciidoc/common_book_info.adoc
new file mode 100644
index 0000000..14737ee
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/common_book_info.adoc
@@ -0,0 +1,38 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[discrete]
+=== License and Disclaimer
+
+The ASF licenses this documentation to you under the Apache License, Version 2.0 (the "License");
+you may not use this documentation except in compliance with the License. You may obtain a copy of
+the License at
+
+[.text-center]
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, this documentation and its contents are
+distributed under the License on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
+either express or implied. See the License for the specific language governing permissions and
+limitations under the License.
+
+[discrete]
+=== Trademarks
+
+All terms mentioned in the text that are known to be trademarks or service marks have been
+appropriately capitalized. Use of such terms in this book should not be regarded as affecting the
+validity of the the trademark or service mark.
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.book.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.book.adoc
new file mode 100644
index 0000000..21b44d0
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.book.adoc
@@ -0,0 +1,46 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+= Apache uimaFIT™
+:Author: Apache UIMA™ Development Community
+:toc-title: User Guide
+
+The document is a manual for users of uimaFIT, a friendly API to the Apache UIMA framework.
+
+include::common_book_info.adoc[leveloffset=+1]
+
+include::tools.uimafit.introduction.adoc[leveloffset=+1]
+
+include::tools.uimafit.gettingstarted.adoc[leveloffset=+1]
+
+include::tools.uimafit.pipelines.adoc[leveloffset=+1]
+
+include::tools.uimafit.experiments.adoc[leveloffset=+1]
+
+include::tools.uimafit.casutil.adoc[leveloffset=+1]
+
+include::tools.uimafit.configurationparameters.adoc[leveloffset=+1]
+
+include::tools.uimafit.externalresources.adoc[leveloffset=+1]
+
+include::tools.uimafit.typesystem.adoc[leveloffset=+1]
+
+include::tools.uimafit.packaging.adoc[leveloffset=+1]
+
+include::tools.uimafit.maven.adoc[leveloffset=+1]
+
+include::tools.uimafit.migration.adoc[leveloffset=+1]
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.casutil.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.casutil.adoc
new file mode 100644
index 0000000..ad9d4cb
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.casutil.adoc
@@ -0,0 +1,83 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.casutil]]
+= CAS Utilities
+
+uimaFIT facilitates working with the CAS and JCas by offering various convenient methods for accessing and navigating annotations and feature structures.
+Additionally, the the convenience methods for JCas access are fully type-safe and return the JCas type or a collection of the JCas type which you wanted to access.
+
+== Access methods
+
+uimaFIT supports the following convenience methods for accessing CAS and JCas structures.
+All methods respect the UIMA index definitions and return annotations or feature structures in the order defined by the indexes.
+Unless the default UIMA index for annotations has been overwritten, annotations are returned sorted by begin (increasing) and end (decreasing).
+
+* `select(cas, type)` - fetch all annotations of the given type from the CAS/JCas. Variants of this method also exist to fetch annotations from a [type]``FSList`` or [type]``FSArray``.
+* `selectAll(cas)` - fetch all annotations from the CAS or fetch all feature structures from the JCas.
+* ``selectBetween(type, annotation1, annotation2)``* - fetch all annotations between the given two annotations.
+* ``selectCovered(type, annotation)``* - fetch all annotations covered by the given annotation. If this operation is used intensively, `indexCovered(...)` should be used to pre-calculate annotation covering information.
+* `selectCovering(type, annotation)*` - fetch all annotations covering the given annotation. If this operation is used intensively, `indexCovering(...)` should be used to pre-calculate annotation covering information.
+* `selectByIndex(cas, type, n)` - fetch the n-th feature structure of the given type.
+* `selectSingle(cas, type)` - fetch the single feature structure of the given type. An exception is thrown if there is not exactly one feature structure of the type.
+* `selectSingleRelative(type, annotation, n)`* - fetch a single annotation relative to the given annotation. A positive [parameter]``n`` fetches the n-th annotation right of the specified annotation, while the a negative [parameter]``n`` fetches to the left.
+* `selectPreceding(type, annotation, n)`* - fetch the n annotations preceding the given annotation. If there are less then n preceding annotations, all preceding annotations are returned.
+* `selectFollowing(type, annotation, n)`* - fetch the n annotations following the given annotation. If there are less then n following annotations, all following annotations are returned.
+
+
+[NOTE]
+====
+For historical reasons, the method marked with * also exist in a version that accepts a CAS/JCas as the first argument.
+These may not work as expected when the annoation arguments provided to the method are from a different CAS/JCas/view.
+Also, for any method accepting two annotations, these should come from the same CAS/JCas/view.
+In future, the potentially problematic signatures may be deprecated, removed, or throw exeptions if these conditions are not met.
+====
+
+[NOTE]
+====
+You should expect the structures returned by these methods to be backed by the CAS/JCas contents.
+In particular, if you remove any feature structures from the CAS while iterating over these structures may cause failures.
+For this reason, you should also not hold on to these structures longer than necessary, as is the case for UIMA ``FSIterator``s as well.
+====
+
+Depending on whether one works with a CAS or JCas, the respective methods are available from the JCasUtil or CasUtil classes.
+
+JCasUtil expect a JCas wrapper class for the [parameter]``type`` argument, e.g. `select(jcas, Token.class)` and return this type or a collection using this generic type.
+Any subtypes of the specified type are returned as well.
+CasUtil expects a UIMA [type]``Type`` instance.
+For conveniently getting these, CasUtil offers the methods `getType(CAS, Class<?>)` or `getType(CAS, String)` which fetch a type either by its JCas wrapper class or by its name.
+
+Unless annotations are specifically required, e.g.
+because begin/end offsets are required, the JCasUtil methods can be used to access any feature structure inheriting from [type]``TOP``, not only annotations.
+The CasUtil methods generally work only on annotations.
+Alternative methods ending in "FS" are provided for accessing arbitrary feature structures, e.g. ``selectFS``.
+
+Examples:
+
+[source,java]
+----
+// CAS version
+Type tokenType = CasUtil.getType(cas, "my.Token");
+for (AnnotationFS token : CasUtil.select(cas, tokenType)) {
+ ...
+}
+
+// JCas version
+for (Token token : JCasUtil.select(jcas, Token.class)) {
+ ...
+}
+----
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.configurationparameters.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.configurationparameters.adoc
new file mode 100644
index 0000000..d36eb07
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.configurationparameters.adoc
@@ -0,0 +1,141 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.configurationparameters]]
+= Configuration Parameters
+
+uimaFIT defines the `@ConfigurationParameter` annotation which can be used to annotate the fields of an analysis engine or collection reader.
+The purpose of this annotation is twofold:
+
+* injection of parameters from the UIMA context into fields
+* declaration of parameter metadata (mandatory, default value, description) which can be used to generate XML descriptors
+
+In a regular UIMA component, parameters need to be manually extracted from the UIMA context, typically requiring a type cast.
+
+[source,java]
+----
+class MyAnalysisEngine extends CasAnnotator_ImplBase {
+ public static final String PARAM_SOURCE_DIRECTORY = "sourceDirectory";
+ private File sourceDirectory;
+
+ public void initialize(UimaContext context)
+ throws ResourceInitializationException {
+
+ sourceDirectory = new File((String) context.getConfigParameterValue(
+ PARAM_SOURCE_DIRECTORY));
+ }
+}
+----
+
+The component has no way to declare a default value or to declare if a parameter is optional or mandatory.
+In addition, any documentation needs to be maintained in !JavaDoc and in the XML descriptor for the component.
+
+With uimaFIT, all this information can be declared in the component using the [class]``@ConfigurationParameter`` annotation.
+
+.`@ConfigurationParameter` annotation
+[cols="1,1,1", frame="all", options="header"]
+|===
+| Parameter
+| Description
+| Default
+
+|name
+|parameter name
+|name of annotated field
+
+|description
+|description of the parameter
+|
+
+|mandatory
+|whether a non-null value must be specified
+|true
+
+|defaultValue
+|the default value if no value is specified
+|
+|===
+
+[source,java]
+----
+class MyAnalysisEngine
+ extends org.apache.uima.fit.component.CasAnnotator_ImplBase {
+
+ /**
+ * Directory to read the data from.
+ */
+ public static final String PARAM_SOURCE_DIRECTORY = "sourceDirectory";
+ @ConfigurationParameter(name=PARAM_SOURCE_DIRECTORY, defaultValue=".")
+ private File sourceDirectory;
+}
+----
+
+Note, that it is no longer necessary to implement the [method]``initialize()`` method.
+uimaFIT takes care of locating the parameter [parameter]``sourceDirectory`` in the UIMA context.
+It recognizes that the [class]``File`` class has a [class]``String`` constructor and uses that to instantiate a new [class]``File`` object from the parameter.
+A parameter is mandatory unless specified otherwise.
+If a mandatory parameter is not specified in the context, an exception is thrown.
+
+The `defaultValue` is used when generating an UIMA component description from the class.
+It should be pointed out in particular, that uimaFIT does not make use of the default value when injecting parameters into fields.
+For this reason, it is possible to have a parameter that is mandatory but does have a default value.
+The default value is used as a parameter value when a component description is generated via the uimaFIT factories unless a parameter is specified in the factory call.
+If a component description in created manually without specifying a value for a mandatory parameter, uimaFIT will generate an exception.
+
+[NOTE]
+====
+You can use the _enhance_ goal of the uimaFIT Maven plugin to pick up the parameter description from the JavaDoc and post it to the [parameter]``description`` field of the [class]``@ConfigurationParameter`` annotation.
+This should be preferred to specifying the description explicitly as part of the annotation.
+====
+
+The parameter injection mechanism is implemented in the `ConfigurationParameterInitializer` class.
+uimaFIT provides several base classes that already come with an `initialize()` method using the initializer:
+
+* `CasAnnotator_ImplBase`
+* `CasCollectionReader_ImplBase`
+* `CasConsumer_ImplBase`
+* `CasFlowController_ImplBase`
+* `CasMultiplier_ImplBase`
+* `JCasAnnotator_ImplBase`
+* `JCasCollectionReader_ImplBase`
+* `JCasConsumer_ImplBase`
+* `JCasFlowController_ImplBase`
+* `JCasMultiplier_ImplBase`
+* `Resource_ImplBase`
+
+The `ConfigurationParameterInitializer` can also be used with shared resources:
+
+[source,java]
+----
+class MySharedResourceObject implements SharedResourceObject {
+ public static final String PARAM_VALUE = "Value";
+ @ConfigurationParameter(name = PARAM_VALUE, mandatory = true)
+ private String value;
+
+ public void load(DataResource aData)
+ throws ResourceInitializationException {
+
+ ConfigurationParameterInitializer.initialize(this, aData);
+ }
+}
+----
+
+Fields that can be annotated with the `@ConfigurationParameter` annotation are any array or collection types (including if they are only typed via interfaces such as `List` or `Set`) of primitive types (`int`, `boolean`, `float`, `double`). Enum types, as well as, fields of the types `Charset`, `File`, `Locale`, `Pattern`, `URI`, and `URL` can also be used.
+These can be initialized either using an object value (e.g. `StandardChartsets.UTF_8``) or a string value (e.g. `"UTF-8"`). Additionally it is possible to inject any fields of types that define a constructor accepting a single `String`.
+These must be initialized from a string value.
+
+Multi-valued parameters can be initialized from single values without having to wrap these into a container.
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.experiments.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.experiments.adoc
new file mode 100644
index 0000000..6968a8e
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.experiments.adoc
@@ -0,0 +1,41 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.experiments]]
+= Running Experiments
+
+The _uimafit-examples_ module contains a package [package]#org.apache.uima.fit.examples.experiment.pos# which demonstrates a very simple experimental setup for testing a part-of-speech tagger.
+You may find this example more accessible if you check out the code from subversion and build it in your own environment.
+
+The documentation for this example can be found in the code itself.
+Please refer to [class]``RunExperiment`` as a starting point.
+The following is copied from the javadoc comments of that file:
+
+[quote]
+`RunExperiment` demonstrates a very common (though simplified) experimental setup in which gold
+standard data is available for some task and you want to evaluate how well your analysis engine
+works against that data. Here we are evaluating `BaselineTagger` which is a (ridiculously)
+simple part-of-speech tagger against the part-of-speech tags found in
+`src/main/resources/org/apache/uima/fit/examples/pos/sample-gold.txt`
+
+The basic strategy is as follows:
+
+* post the data _as is_ into the default view,
+* parse the gold-standard tokens and part-of-speech tags and put the results into another view we will call __GOLD_VIEW__,
+* create another view called _SYSTEM_VIEW_ and copy the text and [class]``Token`` annotations from the _GOLD_VIEW_ into this view,
+* run the [class]``BaselineTagger`` on the _SYSTEM_VIEW_ over the copied [class]``Token`` annoations,
+* evaluate the part-of-speech tags found in the _SYSTEM_VIEW_ with those in the _GOLD_VIEW._
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.externalresources.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.externalresources.adoc
new file mode 100644
index 0000000..3edc63a
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.externalresources.adoc
@@ -0,0 +1,288 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.externalresources]]
+= External Resources
+
+An analysis engine often uses some data model.
+This may be as simple as word frequency counts or as complex as the model of a parser.
+Often these models can become quite large.
+If an analysis engine is deployed multiple times in the same pipeline or runs on multiple CPU cores, memory can be saved by using a shared instance of the data model.
+UIMA supports such a scenario by so-called external resources.
+The following sections illustrates how external resources can be used with uimaFIT.
+
+First create a class for the shared data model.
+Usually this class would load its data from some URI and then expose it via its methods.
+An example would be to load word frequency counts and to provide a `getFrequency()` method.
+In our simple example we do not load anything from the provided URI - we just offer a method to get the URI from which data be loaded.
+
+[source,java]
+----
+// Simple model that only stores the URI it was loaded from. Normally data
+// would be loaded from the URI instead and made accessible through methods
+// in this class. This simple example only allows accessing the URI.
+public static final class SharedModel implements SharedResourceObject {
+ private String uri;
+
+ public void load(DataResource aData)
+ throws ResourceInitializationException {
+
+ uri = aData.getUri().toString();
+ }
+
+ public String getUri() { return uri; }
+}
+----
+
+== Resource injection
+
+=== Regular UIMA components
+
+When an external resource is used in a regular UIMA component, it is usually fetched from the context, cast and copied to a class member variable.
+
+[source,java]
+----
+class MyAnalysisEngine extends CasAnnotator_ImplBase {
+ final static String MODEL_KEY = "Model";
+ private SharedModel model;
+
+ public void initialize(UimaContext context)
+ throws ResourceInitializationException {
+
+ configuredResource = (SharedModel)
+ getContext().getResourceObject(MODEL_KEY);
+ }
+}
+----
+
+uimaFIT can be used to inject external resources into such traditional components using the `createDependencyAndBind()` method.
+To show that this works with any off-the-shelf UIMA component, the following example uses uimaFIT to configure the OpenNLP Tokenizer:
+
+[source,java]
+----
+// Create descriptor
+AnalysisEngineDescription tokenizer = createEngineDescription(
+ Tokenizer.class,
+ UimaUtil.TOKEN_TYPE_PARAMETER, Token.class.getName(),
+ UimaUtil.SENTENCE_TYPE_PARAMETER, Sentence.class.getName());
+
+// Create the external resource dependency for the model and bind it
+createDependencyAndBind(tokenizer, UimaUtil.MODEL_PARAMETER,
+ TokenizerModelResourceImpl.class,
+ "http://opennlp.sourceforge.net/models-1.5/en-token.bin");
+----
+
+[NOTE]
+====
+We recommend declaring parameter constants in the classes that use them, e.g.
+here in `Tokenizer`.
+This way, the parameters for a class can be found easily.
+However, OpenNLP declares parameters centrally in `UimaUtil`.
+Thus, the example above is correct, although unconventional.
+====
+
+[NOTE]
+====
+Note that uimaFIT is unable to perform type-coercion on parameters if a descriptor is created from a class that does not contain `@ConfigurationParameter` annotations, such as the OpenNLP `Tokenizer`.
+Such a descriptor does not contain any parameter declarations! However, it is still possible to configure such a component using uimaFIT by passing exactly the expected types as parameter values.
+Thus, we need use the `getName()` method to get the class name as a string, instead of simply passing the class itself.
+Also, setting multi-valued parameter from a list or single value does not work here.
+Multi-values parameters must be passed as an array of the required type.
+Only the default UIMA types are possible: `String`, `boolean`, `int`, and `float`.
+====
+
+=== uimaFIT-aware components
+
+uimaFIT provides the `@ExternalResource` annotation to inject external resources directly into class member variables.
+
+.`@ExternalResource` annotation
+[cols="1,1,1", frame="all", options="header"]
+|===
+| Parameter
+| Description
+| Default
+
+|key
+|Resource key
+|field name
+
+|api
+|Used when the external resource type is different from the field type, e.g.
+ when using an ExternalResourceLocator
+|field type
+
+|mandatory
+|Whether a value must be specified
+|true
+|===
+
+[source,java]
+----
+// Example annotator that uses the SharedModel. In the process() we only
+// test if the model was properly initialized by uimaFIT
+public static class Annotator
+ extends org.apache.uima.fit.component.JCasAnnotator_ImplBase {
+
+ final static String MODEL_KEY = "Model";
+ @ExternalResource(key = MODEL_KEY)
+ private SharedModel model;
+
+ public void process(JCas aJCas) throws AnalysisEngineProcessException {
+ assertTrue(model.getUri().endsWith("gene_model_v02.bin"));
+ // Prints the instance ID to the console - this proves the same
+ // instance of the SharedModel is used in both Annotator instances.
+ System.out.println(model);
+ }
+}
+----
+
+Note, that it is no longer necessary to implement the `initialize()` method.
+uimaFIT takes care of locating the external resource `Model` in the UIMA context and assigns it to the field `model`.
+If a mandatory resource is not present in the context, an exception is thrown.
+
+The resource injection mechanism is implemented in the `ExternalResourceInitializer` class.
+uimaFIT provides several base classes that already come with an `initialize()` method using the initializer:
+
+* `CasAnnotator_ImplBase`
+* `CasCollectionReader_ImplBase`
+* `CasConsumer_ImplBase`
+* `CasFlowController_ImplBase`
+* `CasMultiplier_ImplBase`
+* `JCasAnnotator_ImplBase`
+* `JCasCollectionReader_ImplBase`
+* `JCasConsumer_ImplBase`
+* `JCasFlowController_ImplBase`
+* `JCasMultiplier_ImplBase`
+* `Resource_ImplBase`
+
+When building a pipeline, external resources can be set of a component just like configuration parameters.
+External resources and configuration parameters can be mixed and appear in any order when creating a component description.
+
+Note that in the following example, we create only one external resource description and use it to configure two different analysis engines.
+Because we only use a single description, also only a single instance of the external resource is created and shared between the two engines.
+[source,java]
+----
+ExternalResourceDescription extDesc = createExternalResourceDescription(
+ SharedModel.class, new File("somemodel.bin"));
+
+// Binding external resource to each Annotator individually
+AnalysisEngineDescription aed1 = createEngineDescription(
+ Annotator.class,
+ Annotator.MODEL_KEY, extDesc);
+
+AnalysisEngineDescription aed2 = createEngineDescription(
+ Annotator.class,
+ Annotator.MODEL_KEY, extDesc);
+
+// Check the external resource was injected
+AnalysisEngineDescription aaed = createEngineDescription(aed1, aed2);
+AnalysisEngine ae = createEngine(aaed);
+ae.process(ae.newJCas());
+----
+
+This example is given as a full JUnit-based example in the the _uimaFIT-examples_ project.
+
+=== Resources extending Resource_ImplBase
+
+One kind of resources extend `Resource_ImplBase`.
+These are the easiest to handle, because uimaFIT's version of `Resource_ImplBase` already implements the necessary logic.
+Just be sure to call `super.initialize()` when overriding `initialize()`.
+Also mind that external resources are not available yet when `initialize()` is called.
+For any initialization logic that requires resources, override and implement `afterResourcesInitialized()`.
+Other than that, injection of external resources works as usual.
+
+[source,java]
+----
+public static class ChainableResource extends Resource_ImplBase {
+ public final static String PARAM_CHAINED_RESOURCE = "chainedResource";
+ @ExternalResource(key = PARAM_CHAINED_RESOURCE)
+ private ChainableResource chainedResource;
+
+ public void afterResourcesInitialized() {
+ // init logic that requires external resources
+ }
+}
+----
+
+=== Resources implementing SharedResourceObject
+
+The other kind of resources implement `SharedResourceObject``.
+Since this is an interface, uimaFIT cannot provide the initialization logic, so you have to implement a couple of things in the resource:
+
+* implement `ExternalResourceAware`
+* declare a configuration parameter `ExternalResourceFactory.PARAM_RESOURCE_NAME` and return its value in `getResourceName()`
+* invoke `ConfigurationParameterInitializer.initialize()` in the `load()` method.
+
+Again, mind that external resource not properly initialized until uimaFIT invokes `afterResourcesInitialized()`.
+
+[source,java]
+----
+public class TestSharedResourceObject implements
+ SharedResourceObject, ExternalResourceAware {
+
+ @ConfigurationParameter(name=ExternalResourceFactory.PARAM_RESOURCE_NAME)
+ private String resourceName;
+
+ public final static String PARAM_CHAINED_RESOURCE = "chainedResource";
+ @ExternalResource(key = PARAM_CHAINED_RESOURCE)
+ private ChainableResource chainedResource;
+
+ public String getResourceName() {
+ return resourceName;
+ }
+
+ public void load(DataResource aData)
+ throws ResourceInitializationException {
+
+ ConfigurationParameterInitializer.initialize(this, aData);
+ // rest of the init logic that does not require external resources
+ }
+
+ public void afterResourcesInitialized() {
+ // init logic that requires external resources
+ }
+}
+----
+
+=== Note on injecting resources into resources
+
+Nested resources are only initialized if they are used in a pipeline which contains at least one component that calls `ConfigurationParameterInitializer.initialize()`.
+Any component extending uimaFIT's component base classes qualifies.
+If you use nested resources in a pipeline without any uimaFIT-aware components, you can just add uimaFIT's `NoopAnnotator` to the pipeline.
+
+== Resource locators
+
+Normally, in UIMA an external resource needs to implement either `SharedResourceObject` or `Resource`.
+In order to inject arbitrary objects, uimaFIT has the concept of `ExternalResourceLocator`.
+When a resource implements this interface, not the resource itself is injected, but the method `getResource()` is called on the resource and the result is injected.
+The following example illustrates how to inject an object from JNDI into a UIMA component:
+
+[source,java]
+----
+class MyAnalysisEngine2 extends JCasAnnotator_ImplBase {
+ static final String RES_DICTIONARY = "dictionary";
+ @ExternalResource(key = RES_DICTIONARY)
+ Dictionary dictionary;
+}
+
+AnalysisEngineDescription desc = createEngineDescription(
+ MyAnalysisEngine2.class);
+
+bindResource(desc, MyAnalysisEngine2.RES_DICTIONARY,
+ JndiResourceLocator.class,
+ JndiResourceLocator.PARAM_NAME, "dictionaries/german");
+----
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.gettingstarted.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.gettingstarted.adoc
new file mode 100644
index 0000000..e2f9eba
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.gettingstarted.adoc
@@ -0,0 +1,147 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.gettingstarted]]
+= Getting Started
+
+This quick start tutorial demonstrates how to use uimaFIT to define and set a configuration parameter in an analysis engine, run it, and generate a descriptor file for it.
+The complete code for this example can be found in the _uimaFIT-examples_ module.
+
+== Adding uimaFIT to your project
+
+The following instructions describe how to add uimaFIT to your project's classpath.
+
+=== Maven users
+
+If you use Maven, then uimaFIT can be added to your project by simply adding uimaFIT as a project dependency by adding the following snippet of XML to your pom.xml file:
+
+[source,xml,subs="+attributes"]
+----
+<dependency>
+ <groupId>org.apache.uima</groupId>
+ <artifactId>uimafit-core</artifactId>
+ <version>{revnumber}</version>
+</dependency>
+----
+
+uimaFIT distributions are hosted by Maven Central and so no repository needs to be added to your pom.xml file.
+
+=== Non-Maven users
+
+If you do not build with Maven, then download uimaFIT from the http://uima.apache.org/downloads.cgi[Apache UIMA downloads page].
+The file name should be uimafit--bin.zip.
+Download and unpack this file.
+The contents of the resulting upacked directory will contain a directory called [path]_lib_.
+Add all of the files in this directory to your classpath.
+
+== A simple analysis engine implementation
+
+Here is the complete analysis engine implementation for this example.
+
+[source,java]
+----
+public class GetStartedQuickAE
+ extends org.apache.uima.fit.component.JCasAnnotator_ImplBase {
+
+ public static final String PARAM_STRING = "stringParam";
+ @ConfigurationParameter(name = PARAM_STRING)
+ private String stringParam;
+
+ @Override
+ public void process(JCas jCas) throws AnalysisEngineProcessException {
+ System.out.println("Hello world! Say 'hi' to " + stringParam);
+ }
+}
+----
+
+The first thing to note is that the member variable [var]``stringParam`` is annotated with [class]``@ConfigurationParameter`` which tells uimaFIT that this is an analysis engine configuration parameter.
+It is best practice to create a public constant for the parameter name, here `PARAM_STRING` The second thing to note is that we extend uimaFIT's version of the [class]``JCasAnnotator_ImplBase``.
+The initialize method of this super class calls:
+
+[source,java]
+----
+ConfigurationParameterInitializer.initializeConfigurationParameters(
+ Object, UimaContext)
+----
+
+which populates the configuration parameters with the appropriate contents of the [interface]``UimaContext``.
+If you do not want to extend uimaFIT's [class]``JCasAnnotator_ImplBase``, then you can call this method directly in the [method]``initialize`` method of your analysis engine or any class that implements [interface]``Initializable``.
+You can call this method for an instance of any class that has configuration parameters.
+
+== Running the analysis engine
+
+The following lines of code demonstrate how to instantiate and run the analysis engine from a main method:
+
+[source,java]
+----
+JCas jCas = JCasFactory.createJCas();
+
+AnalysisEngine analysisEngine = AnalysisEngineFactory.createEngine(
+ GetStartedQuickAE.class,
+ GetStartedQuickAE.PARAM_STRING, "uimaFIT");
+
+analysisEngine.process(jCas);
+----
+
+In a more involved example, we would probably instantiate a collection reader and run this analysis engine over a collection of documents.
+Here, it suffices to simply create a [interface]``JCas``.
+Line 3 instantiates the analysis engine using [class]``AnalysisEngineFactory`` and sets the string parameter named [parameter]``stringParam`` to the value ``uimaFIT``.
+Running this simple program sends the following output to the console:
+
+[source]
+----
+Hello world! Say 'hi' to uimaFIT
+----
+
+Normally you would be using a type system with your analysis components.
+When using uimaFIT, it is easiest to keep your type system descriptors in your source folders and make them known to uimaFIT.
+To do so, create a file [path]_META-INF/org.apache.uima.fit/types.txt_ in a source folder and add references to all your type descriptors to the file, one per line.
+You can also use wildcards.
+For example:
+
+[source]
+----
+classpath*:org/apache/uima/fit/examples/type/Token.xml
+classpath*:org/apache/uima/fit/examples/type/Sentence.xml
+classpath*:org/apache/uima/fit/examples/tutorial/type/*.xml
+----
+
+== Generate a descriptor file
+
+The following lines of code demonstrate how a descriptor file can be generated using the class definition:
+
+[source,java]
+----
+AnalysisEngine analysisEngine = AnalysisEngineFactory.createEngine(
+ GetStartedQuickAE.class,
+ GetStartedQuickAE.PARAM_STRING, "uimaFIT");
+
+analysisEngineDescription.toXML(
+ new FileOutputStream("GetStartedQuickAE.xml"));
+----
+
+If you open the resulting descriptor file you will see that the configuration parameter [parameter]``stringParam`` is defined with the value set to ``uimaFIT``.
+We could now instantiate an analysis engine using this descriptor file with a line of code like this:
+
+[source,java]
+----
+AnalysisEngineFactory.createEngine("GetStartedQuickAE");
+----
+
+But, of course, we really wouldn't want to do that now that we can instantiate analysis engines using the class definition as was done above!
+
+This chapter, of course, did not demonstrate every feature of uimaFIT which provides support for annotating external resources, creating aggregate engines, running pipelines, testing components, among others.
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.introduction.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.introduction.adoc
new file mode 100644
index 0000000..a84671e
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.introduction.adoc
@@ -0,0 +1,122 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.introduction]]
+= Introduction
+
+While uimaFIT provides many features for a UIMA developer, there are two overarching themes that most features fall under.
+These two sides of uimaFIT are,while complementary, largely independent of each other.
+One of the beauties of uimaFIT is that a developer that uses one side of uimaFIT extensively is not required to use the other side at all.
+
+== Simplify Component Implementation
+
+The first broad theme of uimaFIT provides features that __simplify component
+ implementation__.
+Our favorite example of this is the [class]``@ConfigurationParameter`` annotation which allows you to annotate a member variable as a configuration parameter.
+This annotation in combination with the method [method]``ConfigurationParameterInitializer.initialize()`` completely automates the process of initializing member variables with values from the [interface]``UimaContext`` passed into your analysis engine's initialize method.
+Similarly, the annotation [class]``@ExternalResource`` annotation in combination with the method [method]``ExternalResourceInitializer.initialize()`` completely automates the binding of an external resource as defined in the [interface]``UimaContext`` to a member variable.
+Dispensing with manually writing the code that performs these two tasks reduces effort, eliminates verbose and potentially buggy boiler-plate code, and makes implementing a UIMA component more enjoyable.
+Consider, for example, a member variable that is of type [class]``Locale``.
+With uimaFIT you can simply annotate the member variable with [class]``@ConfigurationParameter`` and have your initialize method automatically initialize the variable correctly with a string value in the [interface]``UimaContext`` such as ``en_US``.
+
+== Simplify Component Instantiation
+
+The second broad theme of uimaFIT provides features that __simplify component
+ instantiation__.
+Working with UIMA, have you ever said to yourself "`but I
+ just want to tag some text!?`" What does it take to "`just tag some text?`" Here's a list of things you must do with the traditional approach:
+
+* wrap your tagger as a UIMA analysis engine
+* write a descriptor file for your analysis engine
+* write a CAS consumer that produces the desired output
+* write another descriptor file for the CAS consumer
+* write a descriptor file for a collection reader
+* write a descriptor file that describes a pipeline
+* invoke the Collection Processing Manager with your pipeline descriptor file
+
+
+=== From a class
+
+Each of these steps has its own pitfalls and can be rather time consuming.
+This is a rather unsatisfying answer to our simple desire to just tag some text.
+With uimaFIT you can literally eliminate all of these steps.
+
+Here's a simple snippet of Java code that illustrates "`tagging some text`" with uimaFIT:
+
+[source,java]
+----
+import static org.apache.uima.fit.factory.JCasFactory.createJCas;
+import static org.apache.uima.fit.pipeline.SimplePipeline.runPipeline;
+import static
+ org.apache.uima.fit.factory.AnalysisEngineFactory.createEngineDescription;
+
+JCas jCas = createJCas();
+
+jCas.setDocumentText("some text");
+
+runPipeline(jCas,
+ createEngineDescription(MyTokenizer.class),
+ createEngineDescription(MyTagger.class));
+
+for (Token token : iterate(jCas, Token.class)){
+ System.out.println(token.getTag());
+}
+----
+
+This code uses several static method imports for brevity.
+And while the terseness of this code won't make a Python programmer blush - it is certainly much easier than the seven steps outlined above!
+
+=== From an XML descriptor
+
+uimaFIT provides mechanisms to instantiate and run UIMA components programmatically with or without descriptor files.
+For example, if you have a descriptor file for your analysis engine defined by [class]``MyTagger`` (as shown above), then you can instead instantiate the analysis engine with:
+
+[source,java]
+----
+AnalysisEngineDescription tagger = createEngineDescription(
+ "mypackage.MyTagger");
+----
+
+This will find the descriptor file [path]_mypackage/MyTagger.xml_ by name.
+Similarly, you can find a descriptor file by location with [method]``createEngineDescriptionFromPath()``.
+However, if you want to dispense with XML descriptor files altogether (and you probably do), you can use the method [method]``createEngineDescription()`` as shown above.
+One of the driving motivations for creating the second side of uimaFIT is our frustration with descriptor files and our desire to eliminate them.
+Descriptor files are difficult to maintain because they are generally tightly coupled with java code, they decay without warning, they are wearisome to test, and they proliferate, among other reasons.
+
+== Is this cheating?
+
+One question that is often raised by new uimaFIT users is whether or not it breaks the __UIMA way__.
+That is, does adopting uimaFIT lead me down a path of creating UIMA components and systems that are incompatible with the traditional UIMA approach? The answer to this question is __no__.
+For starters, uimaFIT does not skirt the UIMA mechanism of describing components - it only skips the XML part of it.
+For example, when the method [method]``createEngineDescription()`` is called (as shown above) an [interface]``AnalysisEngineDescription`` is created for the analysis engine.
+This is the same object type that is instantiated when a descriptor file is used.
+So, instead of parsing XML to instantiate an analysis engine description from XML, uimaFIT uses a factory method to instantiate it from method parameters.
+One of the happy benefits of this approach is that for a given [interface]``AnalysisEnginedDescription`` you can generate an XML descriptor file using [method]``AnalysisEngineDescription.toXML()``.
+So, uimaFIT actually provides a very simple and direct path for _generating_ XML descriptor files rather than manually creating and maintaining them!
+
+It is also useful to clarify that if you only want to use one side or the other of uimaFIT, then you are free to do so.
+This is possible precisely because uimaFIT does not workaround UIMA's mechanisms for describing components but rather uses them directly.
+For example, if the only thing you want to use in uimaFIT is the [class]``@ConfigurationParameter``, then you can do so without worrying about what effect this will have on your descriptor files.
+This is because your analysis engine will be initialized with exactly the same [interface]``UimaContext`` regardless of whether you instantiate your analysis engine in the _UIMA way_ or use one of uimaFIT's factory methods.
+Similarly, a UIMA component does not need to be annotated with [class]``@ConfiguratioParameter`` for you to make use of the [method]``createEngineDescription()`` method.
+This is because when you pass configuration parameter values in to the [method]``createEngineDescription()`` method, they are added to an [interface]``AnalysisEngineDescription`` which is used by UIMA to populate a [interface]``UimaContext`` - just as it would if you used a descriptor file.
+
+== Conclusion
+
+Because uimaFIT can be used to simplify component implementation and instantiation it is easy to assume that you can't do one without the other.
+This page has demonstrated that while these two sides of uimaFIT complement each other, they are not coupled together and each can be effectively used without the other.
+Similarly, by understanding how uimaFIT uses the UIMA component description mechanisms directly, one can be assured that uimaFIT enables UIMA development that is compatible and consistent with the UIMA standard and APIs.
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.maven.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.maven.adoc
new file mode 100644
index 0000000..c404d80
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.maven.adoc
@@ -0,0 +1,195 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_tools.uimafit.maven]]
+= uimaFIT Maven Plugin
+
+uimaFIT dynamically generates UIMA component descriptions from annotations in the Java source code.
+The uimaFIT Maven plugin provides the ability to automatically create such annotations in already compiled classes and to automatically generate XML descriptors from the annotated classes.
+
+== enhance goal
+
+The goal enhance allows automatically augmenting compiled classes with uimaFIT annotations.
+Information like vendor, copyright, or version can be obtained from the Maven POM.
+Additionally, descriptions for parameters and components can be generated from Javadoc comments.
+Existing annotations are not overwritten unless forced.
+
+[source,xml]
+----
+<plugin>
+ <groupId>org.apache.uima</groupId>
+ <artifactId>uimafit-maven-plugin</artifactId>
+ <version></version> <!-- change to latest version -->
+ <configuration>
+ <!-- OPTIONAL -->
+ <!-- Override component description in generated descriptors. -->
+ <overrideComponentDescription>false</overrideComponentDescription>
+
+ <!-- OPTIONAL -->
+ <!-- Override version in generated descriptors. -->
+ <overrideComponentVersion>false</overrideComponentVersion>
+
+ <!-- OPTIONAL -->
+ <!-- Override vendor in generated descriptors. -->
+ <overrideComponentVendor>false</overrideComponentVendor>
+
+ <!-- OPTIONAL -->
+ <!-- Override copyright in generated descriptors. -->
+ <overrideComponentCopyright>false</overrideComponentCopyright>
+
+ <!-- OPTIONAL -->
+ <!-- Version to use in generated descriptors. -->
+ <componentVersion>${project.version}</componentVersion>
+
+ <!-- OPTIONAL -->
+ <!-- Vendor to use in generated descriptors. -->
+ <componentVendor>Apache Foundation</componentVendor>
+
+ <!-- OPTIONAL -->
+ <!-- Copyright to use in generated descriptors. -->
+ <componentCopyright>Apache Foundation 2013</componentCopyright>
+
+ <!-- OPTIONAL -->
+ <!-- Source file encoding. -->
+ <encoding>${project.build.sourceEncoding}</encoding>
+
+ <!-- OPTIONAL -->
+ <!-- Generate a report of missing meta data in
+ $project.build.directory/uimafit-missing-meta-data-report.txt -->
+ <generateMissingMetaDataReport>true</generateMissingMetaDataReport>
+
+ <!-- OPTIONAL -->
+ <!-- Fail on missing meta data. This setting has no effect unless
+ generateMissingMetaDataReport is enabled. -->
+ <failOnMissingMetaData>false</failOnMissingMetaData>
+
+ <!-- OPTIONAL -->
+ <!-- Constant name prefixes used for parameters and external resources,
+ e.g. "PARAM_". -->
+ <parameterNameConstantPrefixes>
+ <prefix>PARAM_<prefix/>
+ </parameterNameConstantPrefixes>
+
+ <!-- OPTIONAL -->
+ <!-- Fail on missing meta data. This setting has no effect unless
+ generateMissingMetaDataReport is enabled. -->
+ <externalResourceNameConstantPrefixes>
+ <prefix>KEY_<prefix/>
+ <prefix>RES_<prefix/>
+ </externalResourceNameConstantPrefixes>
+
+ <!-- OPTIONAL -->
+ <!-- Mode of adding type systems found on the classpath via the
+ uimaFIT detection mechanism at compile time to the generated
+ descriptor. By default, no type systems are added. -->
+ <addTypeSystemDescriptions>NONE</addTypeSystemDescriptions>
+
+ </configuration>
+ <executions>
+ <execution>
+ <id>default</id>
+ <phase>process-classes</phase>
+ <goals>
+ <goal>enhance</goal>
+ </goals>
+ </execution>
+ </executions>
+</plugin>
+----
+
+When generating descriptions for configuration parameters or external resources, the plugin supports a common practice of placing the Javadoc on a constant field instead of the parameter or external resource field.
+Per default, parameter name constants must be prefixed with `PARAM_` and external resource key constants must be prefixed with `RES_ ` or `KEY_`.
+
+[source,java]
+----
+/**
+ * Enable or disable my feature.
+ */
+public static final String PARAM_ENABLE_FEATURE = "enableFeature";
+@ConfigurationParameter(name=PARAM_ENABLE_FEATURE)
+private boolean enableFeature;
+
+/**
+ * My external resource.
+ */
+public static final String RES_MY_RESOURCE = "resource";
+@ExternalResource(key=RES_MY_RESOURCE)
+private MyResource resource;
+----
+
+By enabling `generateMissingMetaDataReport`, the build can be made to fail if meta data such as parameter descriptions are missing.
+A report about the missing data is generated in [path]_uimafit-missing-meta-data-report.txt_ in the project build directory.
+
+== generate goal
+
+The generate goal generates XML component descriptors for UIMA components.
+
+[source,xml]
+----
+<plugin>
+ <groupId>org.apache.uima</groupId>
+ <artifactId>uimafit-maven-plugin</artifactId>
+ <version></version> <!-- change to latest version -->
+ <configuration>
+ <!-- OPTIONAL -->
+ <!-- Path where the generated resources are written. -->
+ <outputDirectory>
+ ${project.build.directory}/generated-sources/uimafit
+ </outputDirectory>
+
+ <!-- OPTIONAL -->
+ <!-- Skip generation of META-INF/org.apache.uima.fit/components.txt -->
+ <skipComponentsManifest>false</skipComponentsManifest>
+
+ <!-- OPTIONAL -->
+ <!-- Source file encoding. -->
+ <encoding>${project.build.sourceEncoding}</encoding>
+ </configuration>
+ <executions>
+ <execution>
+ <id>default</id>
+ <phase>process-classes</phase>
+ <goals>
+ <goal>generate</goal>
+ </goals>
+ </execution>
+ </executions>
+</plugin>
+----
+
+In addition to the XML descriptors, a manifest file is written to `META-INF/org.apache.uima.fit/components.txt`.
+This file can be used to conveniently locate the XML descriptors, which are written in the packages next to the classes they describe.
+
+[source]
+----
+classpath*:org/apache/uima/fit/examples/ExampleComponent.xml
+----
+
+It is recommended to use both, the enhance and the generate goal.
+Both goals should be specified in the same execution, first enhance, then generate:
+
+[source,xml]
+----
+<execution>
+ <id>default</id>
+ <phase>process-classes</phase>
+ <goals>
+ <goal>enhance</goal>
+ <goal>generate</goal>
+ </goals>
+</execution>
+----
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.migration.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.migration.adoc
new file mode 100644
index 0000000..e4e87cd
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.migration.adoc
@@ -0,0 +1,189 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.migration]]
+= Migration Guide
+
+This section provides helpful information on incompatible changes between versions.
+
+== Version 2.3.0 to 2.4.0
+
+.Version requirements
+Depends on UIMA 2.10.2, Spring Framework 3.2.16 and Java 7.
+
+Mind the updated version requirements.
+There should be no other potentially problematic changes in this upgrade.
+
+== Version 2.2.0 to 2.3.0
+
+.CasIOUtil deprecated
+The functionality of the uimaFIT CasIOUtil class has been superseded by the core UIMA class CasIOUtils added in UIMA 2.9.0.
+The method signatures in the new class are not the same, but provide more functionality.
+CasIOUtil has been deprecated and documentation has been added which of the CasIOUtils methods should be used instead.
+
+.Version requirements
+Depends on UIMA 2.9.1, Spring Framework 3.2.16 and Java 7.
+
+Mind the updated version requirements.
+There should be no other potentially problematic changes in this upgrade.
+
+== Version 2.1.0 to 2.2.0
+
+.Version requirements
+Depends on UIMA 2.8.1, Spring Framework 3.2.16 and Java 7.
+
+Mind the updated version requirements.
+There should be no other potentially problematic changes in this upgrade.
+
+== Version 2.0.0 to 2.1.0
+
+.Version requirements
+Depends on UIMA 2.6.0 and Java 6.
+
+.AnnotationFactory.createAnnotation()
+No longer throws ``UIMAExcption``.
+If this exception was cought, some IDEs may complain here after upgrading to uimaFIT 2.1.0.
+
+== Version 1.4.0 to 2.0.0
+
+.Version requirements
+Depends on UIMA 2.4.2.
+
+.Backwards compatibility
+Compatibility with legacy annotation is provided by the Legacy support module.
+
+.Change of Maven groupId and artifactId
+The Maven group ID has changed from `org.uimafit` to ``org.apache.uima``.
+
+The artifact ID of the main uimaFIT artifact has been changed from `uimafit` to ``uimafit-core``.
+
+.Change of package names
+The base package has been renamed from `org.uimafit` to ``org.apache.uima.fit``.
+A global search/replace on Java files with for lines starting with `import org.uimafit` and replacing that with `import org.apache.uima.fit` should work.
+
+.@ConfigurationParameter
+The default value for the mandatory attribute now is ``true``.
+The default name of configuration parameters is now the name of the annotated field only.
+The classname is no longer prefixed.
+The method `ConfigurationParameterFactory.createConfigurationParameterName()` that was used to generate the prefixed name has been removed.
+
+.Type detection: META-INF/org.uimafit folder
+The `META-INF/org.uimafit` was renamed to ``META-INF/org.apache.uima.fit``.
+
+.JCasUtil
+The deprecated `JCasUtil.iterate()` methods have been removed. `JCasUtil.select()` should be used instead.
+
+.AnalysisEngineFactory
+All `createAggregateXXX` and `createPrimitiveXXX` methods have been renamed to ``createEngineXXX``.
+The old names are deprecated and will be removed in future versions.
+
+All `createAnalysisEngineXXX` methods have been renamed to ``createEngineXXX``.
+The old names are deprecated and will be removed in future versions.
+
+.CollectionReaderFactory
+All `createDescriptionXXX` methods have been renamed to ``createReaderDescriptionXXX``.
+The old names are deprecated and will be removed in future versions.
+
+All `createCollectionReaderXXX` methods have been renamed to ``createReaderXXX``.
+The old names are deprecated and will be removed in future versions.
+
+.JCasIterable
+`JCasIterable` now only accepts reader and engine descriptions (no instances) and no longer implements the `Iterator` interface.
+Instead, new `JCasIterator` has been added, which replaces `JCasIterable` in that respect.
+
+.CasDumpWriter
+`org.uimafit.component.xwriter.CASDumpWriter` has been renamed to ``org.apache.uima.fit.component.CasDumpWriter``.
+
+.CpePipeline
+`CpePipeline` has been moved to a separate module with the artifact ID `uimafit-cpe` to reduce the dependencies incurred by the main uimaFIT artifact.
+
+.XWriter removed
+The `XWriter` and associated file namers have been removed as they were much more complex then acutally needed.
+As an alternative, `CasIOUtil` has been introduced providing several convenience methods to read/write JCas/CAS data.
+
+.JCasFactory
+Methods only loading JCas data have been removed from ``JCasFactory``.
+The new methods in `CasIOUtil` can be used instead.
+
+== Legacy support module
+
+The compatibility layer should allow you to migrate to uimaFIT without breaking anything.
+You should then be able to gradually change the codebase to be compatible with uimaFIT .
+As far as my tests go, uimaFIT 1.x and can coexist peacefully on the classpath (and indeed both need to be on the classpath in order to use the legacy support module).
+
+To enable the legacy support, make sure that you have a dependency on uimaFIT 1.x and then just add a dependency on the legacy module:
+
+[source]
+----
+<dependency>
+ <groupId>org.uimafit</groupId>
+ <artifactId>uimafit</artifactId>
+ <version>1.4.0</version>
+</dependency>
+<dependency>
+ <groupId>org.apache.uima</groupId>
+ <artifactId>uimafit-legacy-support</artifactId>
+ <version></version>
+</dependency>
+----
+
+uimaFIT automatically detects the presence of the legacy module and uses it - no additional configuration is necessary.
+
+The following bash script may help to partially automatize the source code migration process.
+Please observe that it does not cover all of the necessary changes!
+
+[NOTE]
+====
+The script recursively changes all files under the current working directory! Make sure you are in the right directory before running it! _Use the script at your own
+ risk!_
+====
+
+[source,bash]
+----
+#!/bin/sh
+
+############################################
+# MAKE SURE TO BACKUP YOUR FILES FIRST!
+# SCRIPT RECURSIVELY CHANGES ALL JAVA FILES!
+# USE AT YOUR OWN RISK!
+############################################
+
+# Change of package names
+find . -name '*.java' -print |
+xargs perl -p -i -e 's/org.uimafit/org.apache.uima.fit/g'
+
+find . -name '*.java' -print |
+xargs perl -p -i -e 's/org.uimafit.component.xwriter.CASDumpWriter/\
+org.apache.uima.fit.component.CasDumpWriter/g'
+
+# AnalysisEngineFactory
+find . -name '*.java' -print |
+xargs perl -p -i -e 's/createAggregate/createEngine/g'
+
+find . -name '*.java' -print |
+xargs perl -p -i -e 's/createPrimitive/createEngine/g'
+
+find . -name '*.java' -print |
+xargs perl -p -i -e 's/createAnalysisEngine/createEngine/g'
+
+# Readers
+find . -name '*.java' -print |
+xargs perl -p -i -e 's/createDescription/createReaderDescription/g'
+
+find . -name '*.java' -print |
+xargs perl -p -i -e 's/createCollectionReader/createReader/g'
+----
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.packaging.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.packaging.adoc
new file mode 100644
index 0000000..03ced69
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.packaging.adoc
@@ -0,0 +1,102 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.packaging]]
+= Building an executable JAR
+
+Building an executable JAR including uimaFIT components typically requires extra care.
+Per convention, uimaFIT expects certain information in specific locations on the classpath, e.g.
+the [path]_types.txt_ file that controls the <<_ugr.tools.uimafit.packaging,automatic type system detection>> mechanism must reside at [path]_META-INF/org.apache.uima.fit/types.txt_.
+It often occurs that a project has several dependencies, each supplying its own configuration files at these standard locations.
+However, this causes a problem with naive approaches to creating an executable _fat-jar_ merging all dependencies into a single JAR file.
+Without extra care, the files supplied by the different dependencies overwrite each other during the packaging process and only one file _wins_ in the end.
+As a consequence, the types configured in the other files cannot be detected at runtime.
+Such a native approach is taken, for example, by the Maven Assembly Plugin.
+
+The Maven Shade Plugin provides a convenient alternative for the creation of executable fat-jars, as it provides a mechanism to concatenate the configuration files from different dependencies while creating the fat-jar.
+To use the Maven Shade Plugin with uimaFIT, use the following configuration section in your POM file and make sure to change the `mainClass` as required for your project:
+
+[source,xml]
+----
+<build>
+ <plugins>
+ <plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-shade-plugin</artifactId>
+ <version>2.2</version>
+ <executions>
+ <execution>
+ <phase>package</phase>
+ <goals><goal>shade</goal></goals>
+ <configuration>
+ <transformers>
+ <!-- Set the main class of the executable JAR -->
+ <transformer
+ implementation="org.apache.maven.plugins.shade.\
+ resource.ManifestResourceTransformer">
+ <mainClass>org.apache.uima.fit.example.Main</mainClass>
+ </transformer>
+ <!-- Merge the uimaFIT configuration files -->
+ <transformer
+ implementation="org.apache.maven.plugins.shade.\
+ resource.AppendingTransformer">
+ <resource>\
+ META-INF/org.apache.uima.fit/fsindexes.txt\
+ </resource>
+ </transformer>
+ <transformer
+ implementation="org.apache.maven.plugins.shade.\
+ resource.AppendingTransformer">
+ <resource>\
+ META-INF/org.apache.uima.fit/types.txt\
+ </resource>
+ </transformer>
+ <transformer
+ implementation="org.apache.maven.plugins.shade.\
+ resource.AppendingTransformer">
+ <resource>\
+ META-INF/org.apache.uima.fit/typepriorities.txt\
+ </resource>
+ </transformer>
+ </transformers>
+ <!--
+ Prevent huge shaded artifacts from being deployed
+ to a Maven repository (remove if not desired)
+ -->
+ <outputFile>\
+ ${project.build.directory}/\
+ ${artifactId}-${version}-standalone.jar\
+ </outputFile>
+ </configuration>
+ </execution>
+ </executions>
+ </plugin>
+ </plugins>
+</build>
+----
+
+[NOTE]
+====
+Due to formatting constraints in the PDF version of this manual, the example above uses `\` to indicate a line continuation.
+Remove these and join the lines when you copy/paste this example.
+====
+
+[NOTE]
+====
+You might want to consider also merging additional files, such as LICENSE, NOTICE, or DEPENDENCY files, configuration files for the Java Service Locator API, or files used by other frameworks that uses similar conventions for configuration file locations.
+Check the documentation of the Maven Shade Plugin, as different kinds of configuration files require different specialized transformers.
+====
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.pipelines.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.pipelines.adoc
new file mode 100644
index 0000000..7596e1f
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.pipelines.adoc
@@ -0,0 +1,72 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.pipelines]]
+= Pipelines
+
+UIMA is a component-based architecture that allows composing various processing components into a complex processing pipeline.
+A pipeline typically involves a _collection
+ reader_ which ingests documents and _analysis engines_ that do the actual processing.
+
+Normally, you would run a pipeline using a UIMA Collection Processing Engine or using UIMA AS.
+uimaFIT offers a third alternative that is much simpler to use and well suited for embedding UIMA pipelines into applications or for writing tests.
+
+As uimaFIT does not supply any readers or processing components, we just assume that we have written three components:
+
+* [class]``TextReader`` - reads text files from a directory
+* [class]``Tokenizer`` - annotates tokens
+* [class]``TokenFrequencyWriter`` - writes a list of tokens and their frequency to a file
+
+We create descriptors for all components and run them as a pipeline:
+
+[source,java]
+----
+CollectionReaderDescription reader =
+ CollectionReaderFactory.createReaderDescription(
+ TextReader.class,
+ TextReader.PARAM_INPUT, "/home/uimafit/documents");
+
+AnalysisEngineDescription tokenizer =
+ AnalysisEngineFactory.createEngineDescription(
+ Tokenizer.class);
+
+AnalysisEngineDescription tokenFrequencyWriter =
+ AnalysisEngineFactory.createEngineDescription(
+ TokenFrequencyWriter.class,
+ TokenFrequencyWriter.PARAM_OUTPUT, "counts.txt");
+
+SimplePipeline.runPipeline(reader, tokenizer, writer);
+----
+
+Instead of running the full pipeline end-to-end, we can also process one document at a time and inspect the analysis results:
+
+[source,java]
+----
+CollectionReaderDescription reader =
+ CollectionReaderFactory.createReaderDescription(
+ TextReader.class,
+ TextReader.PARAM_INPUT, "/home/uimafit/documents");
+
+AnalysisEngineDescription tokenizer =
+ AnalysisEngineFactory.createEngineDescription(
+ Tokenizer.class);
+
+for (JCas jcas : SimplePipeline.iteratePipeline(reader, tokenizer)) {
+ System.out.printf("Found %d tokens%n",
+ JCasUtil.select(jcas, Token.class).size());
+}
+----
\ No newline at end of file
diff --git a/uimafit-doc/src/main/asciidoc/tools.uimafit.typesystem.adoc b/uimafit-doc/src/main/asciidoc/tools.uimafit.typesystem.adoc
new file mode 100644
index 0000000..d32028e
--- /dev/null
+++ b/uimafit-doc/src/main/asciidoc/tools.uimafit.typesystem.adoc
@@ -0,0 +1,174 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+[[_ugr.tools.uimafit.typesystem]]
+= Type System Detection
+
+UIMA requires that types that are used in the CAS are defined in XML files - so-called _type system descriptions_ (TSD). Whenever a UIMA component is created, it must be associated with such a type system.
+While it is possible to manually load the type system descriptors and pass them to each UIMA component and to each created CAS, it is quite inconvenient to do so.
+For this reason, uimaFIT supports the automatic detection of such files in the classpath.
+Thus is becomes possible for a UIMA component provider to have component's type automatically detected and thus the components becomes immediately usable by adding it to the classpath.
+
+== Making types auto-detectable
+
+The provider of a type system should create a file [path]_META-INF/org.apache.uima.fit/types.txt_ in the classpath.
+This file should define the locations of the type system descriptions.
+Assume that a type `org.apache.uima.fit.type.Token` is specified in the TSD [path]_org/apache/uima/fit/type/Token.xml_, then the file should have the following contents:
+
+[source]
+----
+classpath*:org/apache/uima/fit/type/Token.xml
+----
+
+[NOTE]
+====
+Mind that the file [path]_types.txt_ is must be located in [path]_META-INF/org.apache.uima.fit_ where [path]_org.apache.uima.fit_ is the name of a sub-directory inside [path]_META-INF_. _We are not using the Java package notation
+ here!_
+====
+
+To specify multiple TSDs, add additional lines to the file.
+If you have a large number of TSDs, you may prefer to add a pattern.
+Assume that we have a large number of TSDs under [path]_org/apache/uima/fit/type_, we can use the following pattern which recursively scans the package [package]#org.apache.uima.fit.type# and all sub-packages for XML files and tries to load them as TSDs.
+
+[source]
+----
+classpath*:org/apache/uima/fit/type/**/*.xml
+----
+
+Try to design your packages structure in a way that TSDs and JCas wrapper classes generated from them are separate from the rest of your code.
+
+If it is not possible or inconvenient to add the `types.txt` file, patterns can also be specified using the system property [parameter]``org.apache.uima.fit.type.import_pattern``.
+Multiple patterns may be specified separated by semicolon:
+
+[source]
+----
+-Dorg.apache.uima.fit.type.import_pattern=\
+ classpath*:org/apache/uima/fit/type/**/*.xml
+----
+
+[NOTE]
+====
+The `\` in the example is used as a line-continuation indicator.
+It and all spaces following it should be ommitted.
+====
+
+== Making index definitions and type priorities auto-detectable
+
+Auto-detection also works for index definitions and type priority definitions.
+For index definitions, the respective file where to register the index definition XML files is [path]_META-INF/org.apache.uima.fit/fsindexes.txt_ and for type priorities, it is [path]_META-INF/org.apache.uima.fit/typepriorities.txt_.
+
+== Using type auto-detection
+
+The auto-detected type system can be obtained from the `TypeSystemDescriptionFactory`:
+
+[source,java]
+----
+TypeSystemDescription tsd =
+ TypeSystemDescriptionFactory.createTypeSystemDescription()
+----
+
+Popular factory methods also support auto-detection:
+
+[source,java]
+----
+AnalysisEngine ae = createEngine(MyEngine.class);
+----
+
+== Multiple META-INF/org.apache.uima.fit/types.txt files
+
+uimaFIT supports multiple [path]_types.txt_ files in the classpath (e.g.
+in differnt JARs). The [path]_types.txt_ files are located via Spring using the classpath search pattern:
+
+[source,java]
+----
+TYPE_MANIFEST_PATTERN = "classpath*:META-INF/org.apache.uima.fit/types.txt"
+----
+
+This resolves to a list URLs pointing to ALL [path]_types.txt_ files.
+The resolved URLs are unique and will point either to a specific point in the file system or into a specific JAR.
+These URLs can be handled by the standard Java URL loading mechanism.
+Example:
+
+[source,java]
+----
+jar:/path/to/syntax-types.jar!/META-INF/org.apache.uima.fit/types.txt
+jar:/path/to/token-types.jar!/META-INF/org.apache.uima.fit/types.txt
+----
+
+uimaFIT then reads all patters from all of these URLs and uses these to search the classpath again.
+The patterns now resolve to a list of URLs pointing to the individual type system XML descriptors.
+All of these URLs are collected in a set to avoid duplicate loading (for performance optimization - not strictly necessary because the UIMA type system merger can handle compatible duplicates). Then the descriptors are loaded into memory and merged using the standard UIMA type system merger (`CasCreationUtils.mergeTypeSystems()`). Example:
+
+[source]
+----
+jar:/path/to/syntax-types.jar!/desc/types/Syntax.xml
+jar:/path/to/token-types.jar!/org/foobar/typesystems/Tokens.xml
+----
+
+Voilá, the result is a type system covering all types could be found in the classpath.
+
+It is recommended
+
+. to put type system descriptors into packages resembling a namespace you "own" and to use a package-scoped wildcard search
++
+[source]
+----
+classpath*:org/apache/uima/fit/type/**/*.xml`
+----
+. or when putting descriptors into a "well-known" package like [package]#desc.type#, that [path]_types.txt_ file should explicitly list all type system descriptors instead of using a wildcard search
++
+[source]
+----
+classpath*:desc/type/Token.xml
+classpath*:desc/type/Syntax.xml
+----
+
+Method 1 should be preferred.
+Both methods can be mixed.
+
+== Performance note and caching
+
+Currently uimaFIT evaluates the patterns for TSDs once and caches the locations, but not the actual merged type system description.
+A rescan can be forced using `TypeSystemDescriptionFactory.forceTypeDescriptorsScan()`.
+This may change in future.
+
+== Potential problems
+
+The mechanism works fine.
+However, there are specific issues with Java in general that one should be aware of.
+
+=== m2eclipse fails to copy descriptors to target/classes
+
+There seems to be a bug in some older versions of m2eclipse that causes resources not always to be copied to [path]_target/classes_.
+If UIMA complains about type definitions missing at runtime, try to _clean/rebuild_ your project and carefully check the m2eclipse console in the console view for error messages that might cause m2eclipse to abort.
+
+=== Class version conflicts
+
+A problem can occur if you end up having multiple incompatible versions of the same type system in the classpath.
+This is a general problem and not related to the auto-detection feature.
+It is the same as when you have incompatible version of a particular class (e.g. `JCas` wrapper or some third-party-library) in the classpath.
+The behavior of the Java Classloader is undefined in that case.
+The detection will do its best to try and load everything it can find, but the UIMA type system merger may barf or you may end up with undefined behavior at runtime because one of the class versions is used at random.
+
+=== Classes and resources in the default package
+
+It is bad practice to place classes into the default (unnamed) package.
+In fact it is not possible to import classes from the default package in another class.
+Similarly it is a bad idea to put resources at the root of the classpath.
+The Spring documentation on resources http://static.springsource.org/spring/docs/3.0.x/reference/resources.html#resources-app-ctx-wildcards-in-resource-paths[explains this in detail].
+
+For this reason the [path]_types.txt_ resides in [path]_/META-INF/org.apache.uima.fit_ and it is suggest that type system descriptors reside either in a proper package like [path]_/org/foobar/typesystems/XXX.xml_ or in [path]_/desc/types/XXX.xml_.
\ No newline at end of file
diff --git a/uimafit-docbook/pom.xml b/uimafit-docbook/pom.xml
deleted file mode 100644
index a9a4b33..0000000
--- a/uimafit-docbook/pom.xml
+++ /dev/null
@@ -1,36 +0,0 @@
-<?xml version="1.0" encoding="UTF-8"?>
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
- <modelVersion>4.0.0</modelVersion>
- <parent>
- <groupId>org.apache.uima</groupId>
- <artifactId>uimafit-parent</artifactId>
- <version>2.5.1-SNAPSHOT</version>
- <relativePath>../uimafit-parent</relativePath>
- </parent>
- <artifactId>uimafit-docbook</artifactId>
- <name>Apache UIMA uimaFIT - Documentation</name>
- <packaging>pom</packaging>
- <properties>
- <uimaScmProject>${project.artifactId}</uimaScmProject>
- <bookNameRoot>tools.uimafit.book</bookNameRoot>
- <maven.deploy.skip>true</maven.deploy.skip>
- </properties>
-</project>
\ No newline at end of file
diff --git a/uimafit-docbook/src/docbook/common_book_info.xml b/uimafit-docbook/src/docbook/common_book_info.xml
deleted file mode 100644
index 69264a8..0000000
--- a/uimafit-docbook/src/docbook/common_book_info.xml
+++ /dev/null
@@ -1,79 +0,0 @@
-<?xml version="1.0" encoding="UTF-8"?>
-<!DOCTYPE bookinfo PUBLIC "-//OASIS//DTD DocBook XML V4.4//EN"
-"http://www.oasis-open.org/docbook/xml/4.4/docbookx.dtd">
-<!--
-Licensed to the Apache Software Foundation (ASF) under one
-or more contributor license agreements. See the NOTICE file
-distributed with this work for additional information
-regarding copyright ownership. The ASF licenses this file
-to you under the Apache License, Version 2.0 (the
-"License"); you may not use this file except in compliance
-with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing,
-software distributed under the License is distributed on an
-"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-KIND, either express or implied. See the License for the
-specific language governing permissions and limitations
-under the License.
--->
-<bookinfo>
-
- <releaseinfo>Version <?eval ${project.version}?></releaseinfo>
-
- <productname>Apache uimaFIT™</productname>
-
- <authorgroup>
- <corpauthor>Written and maintained by the Apache UIMA™ Development Community</corpauthor>
- </authorgroup>
-
- <!--
- <mediaobject>
- <imageobject>
- <imagedata fileref="images/UIMAlogoLarge.png"/>
- </imageobject>
- </mediaobject>
- -->
- <legalnotice>
- <para> </para>
- <formalpara>
- <title>License and Disclaimer</title>
-
- <para>The ASF licenses this documentation
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this documentation except in compliance
- with the License. You may obtain a copy of the License at
-
- <blockquote>
- <para><ulink url="http://www.apache.org/licenses/LICENSE-2.0"/></para>
- </blockquote>
-
- Unless required by applicable law or agreed to in writing,
- this documentation and its contents are distributed under the License
- on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
- </para>
- </formalpara>
- <para> </para>
- <para> </para>
- <formalpara>
- <title>Trademarks</title>
- <para>All terms mentioned in the text that are known to be trademarks or
- service marks have been appropriately capitalized. Use of such terms
- in this book should not be regarded as affecting the validity of the
- the trademark or service mark.
- </para>
- </formalpara>
- </legalnotice>
- <copyright>
- <year><?eval ${project.inceptionYear}?></year>
- <year><?eval ${project.properties.buildYear}?></year>
- <holder>The Apache Software Foundation</holder>
- </copyright>
- <pubdate><?eval ${project.properties.buildMonth}?>, <?eval ${project.properties.buildYear}?></pubdate>
- </bookinfo>
\ No newline at end of file
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.book.xml b/uimafit-docbook/src/docbook/tools.uimafit.book.xml
deleted file mode 100644
index 3e9b5e6..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.book.xml
+++ /dev/null
@@ -1,49 +0,0 @@
-<?xml version="1.0" encoding="UTF-8"?>
-<!DOCTYPE book PUBLIC "-//OASIS//DTD DocBook XML V4.4//EN"
-"http://www.oasis-open.org/docbook/xml/4.4/docbookx.dtd">
-<!--
-Licensed to the Apache Software Foundation (ASF) under one
-or more contributor license agreements. See the NOTICE file
-distributed with this work for additional information
-regarding copyright ownership. The ASF licenses this file
-to you under the Apache License, Version 2.0 (the
-"License"); you may not use this file except in compliance
-with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing,
-software distributed under the License is distributed on an
-"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-KIND, either express or implied. See the License for the
-specific language governing permissions and limitations
-under the License.
--->
-<book lang="en">
- <title>Apache uimaFIT™ Guide and Reference</title>
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="common_book_info.xml"/>
-
- <toc/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.introduction.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.gettingstarted.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.pipelines.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.experiments.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.casutil.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.configurationparameters.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.externalresources.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.typesystem.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.packaging.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.maven.xml"/>
-
- <xi:include xmlns:xi="http://www.w3.org/2001/XInclude" href="tools.uimafit.migration.xml"/>
-</book>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.casutil.xml b/uimafit-docbook/src/docbook/tools.uimafit.casutil.xml
deleted file mode 100644
index 746cffb..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.casutil.xml
+++ /dev/null
@@ -1,122 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.casutil">
- <title>CAS Utilities</title>
- <para>uimaFIT facilitates working with the CAS and JCas by offering various convenient methods for
- accessing and navigating annotations and feature structures. Additionally, the the convenience
- methods for JCas access are fully type-safe and return the JCas type or a collection of the JCas
- type which you wanted to access.</para>
- <section>
- <title>Access methods</title>
- <para>uimaFIT supports the following convenience methods for accessing CAS and JCas structures.
- All methods respect the UIMA index definitions and return annotations or feature structures in
- the order defined by the indexes. Unless the default UIMA index for annotations has been
- overwritten, annotations are returned sorted by begin (increasing) and end
- (decreasing).</para>
- <itemizedlist>
- <listitem>
- <para><code>select(cas, type)</code> - fetch all annotations of the given type from the
- CAS/JCas. Variants of this method also exist to fetch annotations from a
- <type>FSList</type> or <type>FSArray</type>.</para>
- </listitem>
- <listitem>
- <para><code>selectAll(cas)</code> - fetch all annotations from the CAS or fetch all feature
- structures from the JCas.</para>
- </listitem>
- <listitem>
- <para><code>selectBetween(type, annotation1, annotation2)</code>* - fetch all annotations
- between the given two annotations.</para>
- </listitem>
- <listitem>
- <para><code>selectCovered(type, annotation)</code>* - fetch all annotations covered by the
- given annotation. If this operation is used intensively, <code>indexCovered(...)</code>
- should be used to pre-calculate annotation covering information.</para>
- </listitem>
- <listitem>
- <para><code>selectCovering(type, annotation)*</code> - fetch all annotations covering the
- given annotation. If this operation is used intensively, <code>indexCovering(...)</code>
- should be used to pre-calculate annotation covering information.</para>
- </listitem>
- <listitem>
- <para><code>selectByIndex(cas, type, n)</code> - fetch the n-th feature structure of the
- given type.</para>
- </listitem>
- <listitem>
- <para><code>selectSingle(cas, type)</code> - fetch the single feature structure of the given
- type. An exception is thrown if there is not exactly one feature structure of the type.
- </para>
- </listitem>
- <listitem>
- <para><code>selectSingleRelative(type, annotation, n)</code>* - fetch a single annotation
- relative to the given annotation. A positive <parameter>n</parameter> fetches the n-th
- annotation right of the specified annotation, while the a negative
- <parameter>n</parameter> fetches to the left.</para>
- </listitem>
- <listitem>
- <para><code>selectPreceding(type, annotation, n)</code>* - fetch the n annotations preceding
- the given annotation. If there are less then n preceding annotations, all preceding
- annotations are returned.</para>
- </listitem>
- <listitem>
- <para><code>selectFollowing(type, annotation, n)</code>* - fetch the n annotations following
- the given annotation. If there are less then n following annotations, all following
- annotations are returned.</para>
- </listitem>
- </itemizedlist>
- <note>
- <para>For historical reasons, the method marked with * also exist in a version that accepts a
- CAS/JCas as the first argument. These may not work as expected when the annoation arguments
- provided to the method are from a different CAS/JCas/view. Also, for any method accepting
- two annotations, these should come from the same CAS/JCas/view. In future, the potentially
- problematic signatures may be deprecated, removed, or throw exeptions if these conditions
- are not met.</para>
- </note>
- <note>
- <para>You should expect the structures returned by these methods to be backed by the CAS/JCas
- contents. In particular, if you remove any feature structures from the CAS while iterating
- over these structures may cause failures. For this reason, you should also not hold on to
- these structures longer than necessary, as is the case for UIMA <code>FSIterator</code>s as
- well.</para>
- </note>
- <para>Depending on whether one works with a CAS or JCas, the respective methods are available
- from the JCasUtil or CasUtil classes. </para>
- <para>JCasUtil expect a JCas wrapper class for the <parameter>type</parameter> argument, e.g.
- <code>select(jcas, Token.class)</code> and return this type or a collection using this
- generic type. Any subtypes of the specified type are returned as well. CasUtil expects a UIMA
- <type>Type</type> instance. For conveniently getting these, CasUtil offers the methods
- <code>getType(CAS, Class<?>)</code> or <code>getType(CAS, String)</code> which fetch a
- type either by its JCas wrapper class or by its name.</para>
- <para>Unless annotations are specifically required, e.g. because begin/end offsets are required,
- the JCasUtil methods can be used to access any feature structure inheriting from
- <type>TOP</type>, not only annotations. The CasUtil methods generally work only on
- annotations. Alternative methods ending in "FS" are provided for accessing arbitrary feature
- structures, e.g. <code>selectFS</code>.</para>
- <para>Examples:</para>
- <programlisting>// CAS version
-Type tokenType = CasUtil.getType(cas, "my.Token");
-for (AnnotationFS token : CasUtil.select(cas, tokenType)) {
- ...
-}
-
-// JCas version
-for (Token token : JCasUtil.select(jcas, Token.class)) {
- ...
-}</programlisting>
- </section>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.configurationparameters.xml b/uimafit-docbook/src/docbook/tools.uimafit.configurationparameters.xml
deleted file mode 100644
index fd277e4..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.configurationparameters.xml
+++ /dev/null
@@ -1,185 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.configurationparameters">
- <title>Configuration Parameters</title>
- <para>uimaFIT defines the <classname>@ConfigurationParameter</classname> annotation which can be
- used to annotate the fields of an analysis engine or collection reader. The purpose of this
- annotation is twofold:<itemizedlist>
- <listitem>
- <para>injection of parameters from the UIMA context into fields</para>
- </listitem>
- <listitem>
- <para>declaration of parameter metadata (mandatory, default value, description) which can be
- used to generate XML descriptors</para>
- </listitem>
- </itemizedlist>In a regular UIMA component, parameters need to be manually extracted from the
- UIMA context, typically requiring a type cast. </para>
- <programlisting format="linespecific">class MyAnalysisEngine extends CasAnnotator_ImplBase {
- public static final String PARAM_SOURCE_DIRECTORY = "sourceDirectory";
- private File sourceDirectory;
-
- public void initialize(UimaContext context)
- throws ResourceInitializationException {
-
- sourceDirectory = new File((String) context.getConfigParameterValue(
- PARAM_SOURCE_DIRECTORY));
- }
-}</programlisting>
- <para>The component has no way to declare a default value or to declare if a parameter is optional
- or mandatory. In addition, any documentation needs to be maintained in !JavaDoc and in the XML
- descriptor for the component.</para>
- <para>With uimaFIT, all this information can be declared in the component using the
- <classname>@ConfigurationParameter</classname> annotation.<table frame="all">
- <title><classname>@ConfigurationParameter</classname> annotation</title>
- <tgroup cols="3">
- <colspec colname="c1" colnum="1" colwidth="1.0*"/>
- <colspec colname="c2" colnum="2" colwidth="1*"/>
- <colspec colname="c3" colnum="3" colwidth="1.0*"/>
- <thead>
- <row>
- <entry>Parameter</entry>
- <entry>Description</entry>
- <entry>Default</entry>
- </row>
- </thead>
- <tbody>
- <row>
- <entry>name</entry>
- <entry>parameter name</entry>
- <entry>name of annotated field</entry>
- </row>
- <row>
- <entry>description</entry>
- <entry>description of the parameter</entry>
- <entry/>
- </row>
- <row>
- <entry>mandatory</entry>
- <entry>whether a non-null value must be specified </entry>
- <entry>true</entry>
- </row>
- <row>
- <entry>defaultValue</entry>
- <entry>the default value if no value is specified</entry>
- <entry/>
- </row>
- </tbody>
- </tgroup>
- </table></para>
- <programlisting>class MyAnalysisEngine
- extends org.apache.uima.fit.component.CasAnnotator_ImplBase {
-
- /**
- * Directory to read the data from.
- */
- public static final String PARAM_SOURCE_DIRECTORY = "sourceDirectory";
- @ConfigurationParameter(name=PARAM_SOURCE_DIRECTORY, defaultValue=".")
- private File sourceDirectory;
-}</programlisting>
- <para>Note, that it is no longer necessary to implement the <methodname>initialize()</methodname>
- method. uimaFIT takes care of locating the parameter <parameter>sourceDirectory</parameter> in
- the UIMA context. It recognizes that the <classname>File</classname> class has a
- <classname>String</classname> constructor and uses that to instantiate a new
- <classname>File</classname> object from the parameter. A parameter is mandatory unless
- specified otherwise. If a mandatory parameter is not specified in the context, an exception is
- thrown.</para>
- <para>The <parameter>defaultValue</parameter> is used when generating an UIMA component
- description from the class. It should be pointed out in particular, that uimaFIT does not make
- use of the default value when injecting parameters into fields. For this reason, it is possible
- to have a parameter that is mandatory but does have a default value. The default value is used
- as a parameter value when a component description is generated via the uimaFIT factories unless
- a parameter is specified in the factory call. If a component description in created manually
- without specifying a value for a mandatory parameter, uimaFIT will generate an exception.</para>
- <note>
- <para>You can use the <emphasis>enhance</emphasis> goal of the uimaFIT Maven plugin to pick up
- the parameter description from the JavaDoc and post it to the
- <parameter>description</parameter> field of the
- <classname>@ConfigurationParameter</classname> annotation. This should be preferred to
- specifying the description explicitly as part of the annotation.</para>
- </note>
- <para>The parameter injection mechanism is implemented in the
- <classname>ConfigurationParameterInitializer</classname> class. uimaFIT provides several base
- classes that already come with an <methodname>initialize()</methodname> method using the
- initializer:</para>
- <itemizedlist>
- <listitem>
- <para><classname>CasAnnotator_ImplBase</classname>`</para>
- </listitem>
- <listitem>
- <para><classname>CasCollectionReader_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>CasConsumer_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>CasFlowController_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>CasMultiplier_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasAnnotator_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasCollectionReader_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasConsumer_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasFlowController_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasMultiplier_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>Resource_ImplBase</classname></para>
- </listitem>
- </itemizedlist>
- <para>The <classname>ConfigurationParameterInitializer</classname> can also be used with shared
- resources:</para>
- <programlisting>class MySharedResourceObject implements SharedResourceObject {
- public static final String PARAM_VALUE = "Value";
- @ConfigurationParameter(name = PARAM_VALUE, mandatory = true)
- private String value;
-
- public void load(DataResource aData)
- throws ResourceInitializationException {
-
- ConfigurationParameterInitializer.initialize(this, aData);
- }
-}</programlisting>
- <para>Fields that can be annotated with the <classname>@ConfigurationParameter</classname>
- annotation are any array or collection types (including if they are only typed via interfaces
- such as <type>List</type> or <type>Set</type>) of primitive types (<type>int</type>,
- <type>boolean</type>, <type>float</type>, <type>double</type>). Enum types, as well as,
- fields of the types
- <classname>Charset</classname>,
- <classname>File</classname>,
- <classname>Locale</classname>,
- <classname>Pattern</classname>,
- <classname>URI</classname>, and
- <classname>URL</classname> can also be used.
- These can be initialized either using an object value (e.g. <code>StandardChartsets.UTF_8</code>)
- or a string value (e.g. <code>"UTF-8"</code>).
- Additionally it is possible to inject any fields of types that define a constructor accepting
- a single <classname>String</classname>. These must be initialized from a string value.</para>
- <para>Multi-valued parameters can be initialized from single values without having to wrap these
- into a container.</para>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.experiments.xml b/uimafit-docbook/src/docbook/tools.uimafit.experiments.xml
deleted file mode 100644
index e01c151..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.experiments.xml
+++ /dev/null
@@ -1,60 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.experiments">
- <title>Running Experiments</title>
- <para>The <emphasis>uimafit-examples</emphasis> module contains a package
- <package>org.apache.uima.fit.examples.experiment.pos</package> which demonstrates a very simple
- experimental setup for testing a part-of-speech tagger. You may find this example more
- accessible if you check out the code from subversion and build it in your own
- environment.</para>
- <para>The documentation for this example can be found in the code itself. Please refer to
- <classname>RunExperiment</classname> as a starting point. The following is copied from the
- javadoc comments of that file:</para>
- <blockquote>
- <para><classname>RunExperiment</classname> demonstrates a very common (though simplified)
- experimental setup in which gold standard data is available for some task and you want to
- evaluate how well your analysis engine works against that data. Here we are evaluating
- <classname>BaselineTagger</classname> which is a (ridiculously) simple part-of-speech tagger
- against the part-of-speech tags found in
- <filename>src/main/resources/org/apache/uima/fit/examples/pos/sample-gold.txt</filename></para>
- </blockquote>
- <para>The basic strategy is as follows:</para>
- <itemizedlist>
- <listitem>
- <para>post the data <emphasis>as is</emphasis> into the default view,</para>
- </listitem>
- <listitem>
- <para>parse the gold-standard tokens and part-of-speech tags and put the results into another
- view we will call <emphasis>GOLD_VIEW</emphasis>,</para>
- </listitem>
- <listitem>
- <para>create another view called <emphasis>SYSTEM_VIEW</emphasis> and copy the text and
- <classname>Token</classname> annotations from the <emphasis>GOLD_VIEW</emphasis> into this
- view,</para>
- </listitem>
- <listitem>
- <para>run the <classname>BaselineTagger</classname> on the <emphasis>SYSTEM_VIEW</emphasis>
- over the copied <classname>Token</classname> annoations,</para>
- </listitem>
- <listitem>
- <para>evaluate the part-of-speech tags found in the <emphasis>SYSTEM_VIEW</emphasis> with
- those in the <emphasis>GOLD_VIEW.</emphasis></para>
- </listitem>
- </itemizedlist>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.externalresources.xml b/uimafit-docbook/src/docbook/tools.uimafit.externalresources.xml
deleted file mode 100644
index 970f0ae..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.externalresources.xml
+++ /dev/null
@@ -1,321 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.externalresources">
- <title>External Resources</title>
- <para>An analysis engine often uses some data model. This may be as simple as word frequency
- counts or as complex as the model of a parser. Often these models can become quite large. If an
- analysis engine is deployed multiple times in the same pipeline or runs on multiple CPU cores,
- memory can be saved by using a shared instance of the data model. UIMA supports such a scenario
- by so-called external resources. The following sections illustrates how external resources can
- be used with uimaFIT.</para>
- <para>First create a class for the shared data model. Usually this class would load its data from
- some URI and then expose it via its methods. An example would be to load word frequency counts
- and to provide a <methodname>getFrequency()</methodname> method. In our simple example we do not
- load anything from the provided URI - we just offer a method to get the URI from which data be
- loaded.</para>
- <programlisting>// Simple model that only stores the URI it was loaded from. Normally data
-// would be loaded from the URI instead and made accessible through methods
-// in this class. This simple example only allows accessing the URI.
-public static final class SharedModel implements SharedResourceObject {
- private String uri;
-
- public void load(DataResource aData)
- throws ResourceInitializationException {
-
- uri = aData.getUri().toString();
- }
-
- public String getUri() { return uri; }
-}</programlisting>
- <section>
- <title>Resource injection</title>
- <section>
- <title>Regular UIMA components</title>
- <para>When an external resource is used in a regular UIMA component, it is usually fetched
- from the context, cast and copied to a class member variable.</para>
- <programlisting>class MyAnalysisEngine extends CasAnnotator_ImplBase {
- final static String MODEL_KEY = "Model";
- private SharedModel model;
-
- public void initialize(UimaContext context)
- throws ResourceInitializationException {
-
- configuredResource = (SharedModel)
- getContext().getResourceObject(MODEL_KEY);
- }
-}</programlisting>
- <para>uimaFIT can be used to inject external resources into such traditional components using
- the <methodname>createDependencyAndBind()</methodname> method. To show that this works with
- any off-the-shelf UIMA component, the following example uses uimaFIT to configure the
- OpenNLP Tokenizer:</para>
- <programlisting>// Create descriptor
-AnalysisEngineDescription tokenizer = createEngineDescription(
- Tokenizer.class,
- UimaUtil.TOKEN_TYPE_PARAMETER, Token.class.getName(),
- UimaUtil.SENTENCE_TYPE_PARAMETER, Sentence.class.getName());
-
-// Create the external resource dependency for the model and bind it
-createDependencyAndBind(tokenizer, UimaUtil.MODEL_PARAMETER,
- TokenizerModelResourceImpl.class,
- "http://opennlp.sourceforge.net/models-1.5/en-token.bin");</programlisting>
- <note>
- <para>We recommend declaring parameter constants in the classes that use them, e.g. here
- in <classname>Tokenizer</classname>. This way, the parameters for a class can be found
- easily. However, OpenNLP declares parameters centrally in <classname>UimaUtil</classname>.
- Thus, the example above is correct, although unconvential.</para>
- </note>
- <note>
- <para>Note that uimaFIT is unable to perform type-coercion on parameters if a descriptor
- is created from a class that does not contain <classname>@ConfigurationParameter</classname>
- annotations, such as the OpenNLP <classname>Tokenizer</classname>. Such a descriptor does
- not contain any parameter declarations! However, it is
- still possible to configure such a component using uimaFIT by passing exactly the expected
- types as parameter values. Thus, we need use the <methodname>getName()</methodname> method
- to get the class name as a string, instead of simply passing the class itself. Also, setting
- multi-valued parameter from a list or single value does not work here. Multi-values parameters
- must be passed as an array of the required type. Only the default UIMA types are possible:
- <type>String</type>, <type>boolean</type>, <type>int</type>, and <type>float</type>.</para>
- </note>
- </section>
- <section>
- <title>uimaFIT-aware components</title>
- <para>uimaFIT provides the <classname>@ExternalResource</classname> annotation to inject
- external resources directly into class member variables.</para>
- <table frame="all">
- <title><classname>@ExternalResource</classname> annotation</title>
- <tgroup cols="3">
- <colspec colname="c1" colnum="1" colwidth="1.0*"/>
- <colspec colname="c2" colnum="2" colwidth="1.0*"/>
- <colspec colname="c3" colnum="3" colwidth="1.0*"/>
- <thead>
- <row>
- <entry>Parameter</entry>
- <entry>Description</entry>
- <entry>Default</entry>
- </row>
- </thead>
- <tbody>
- <row>
- <entry>key</entry>
- <entry>Resource key</entry>
- <entry>field name</entry>
- </row>
- <row>
- <entry>api</entry>
- <entry>Used when the external resource type is different from the field type, e.g.
- when using an ExternalResourceLocator</entry>
- <entry>field type</entry>
- </row>
- <row>
- <entry>mandatory</entry>
- <entry>Whether a value must be specified</entry>
- <entry>true</entry>
- </row>
- </tbody>
- </tgroup>
- </table>
- <programlisting>// Example annotator that uses the SharedModel. In the process() we only
-// test if the model was properly initialized by uimaFIT
-public static class Annotator
- extends org.apache.uima.fit.component.JCasAnnotator_ImplBase {
-
- final static String MODEL_KEY = "Model";
- @ExternalResource(key = MODEL_KEY)
- private SharedModel model;
-
- public void process(JCas aJCas) throws AnalysisEngineProcessException {
- assertTrue(model.getUri().endsWith("gene_model_v02.bin"));
- // Prints the instance ID to the console - this proves the same
- // instance of the SharedModel is used in both Annotator instances.
- System.out.println(model);
- }
-}</programlisting>
- <para>Note, that it is no longer necessary to implement the
- <methodname>initialize()</methodname> method. uimaFIT takes care of locating the external
- resource <parameter>Model</parameter> in the UIMA context and assigns it to the field
- <varname>model</varname>. If a mandatory resource is not present in the context, an
- exception is thrown.</para>
- <para>The resource injection mechanism is implemented in the
- <classname>ExternalResourceInitializer</classname> class. uimaFIT provides several base
- classes that already come with an <methodname>initialize()</methodname> method using the
- initializer:</para>
- <itemizedlist>
- <listitem>
- <para><classname>CasAnnotator_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>CasCollectionReader_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>CasConsumer_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>CasFlowController_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>CasMultiplier_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasAnnotator_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasCollectionReader_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasConsumer_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasFlowController_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>JCasMultiplier_ImplBase</classname></para>
- </listitem>
- <listitem>
- <para><classname>Resource_ImplBase</classname></para>
- </listitem>
- </itemizedlist>
- <para>When building a pipeline, external resources can be set of a component just like
- configuration parameters. External resources and configuration parameters can be mixed and
- appear in any order when creating a component description.</para>
- <para>Note that in the following example, we create only one external resource description and
- use it to configure two different analysis engines. Because we only use a single
- description, also only a single instance of the external resource is created and shared
- between the two engines.
- <programlisting>ExternalResourceDescription extDesc = createExternalResourceDescription(
- SharedModel.class, new File("somemodel.bin"));
-
-// Binding external resource to each Annotator individually
-AnalysisEngineDescription aed1 = createEngineDescription(
- Annotator.class,
- Annotator.MODEL_KEY, extDesc);
-
-AnalysisEngineDescription aed2 = createEngineDescription(
- Annotator.class,
- Annotator.MODEL_KEY, extDesc);
-
-// Check the external resource was injected
-AnalysisEngineDescription aaed = createEngineDescription(aed1, aed2);
-AnalysisEngine ae = createEngine(aaed);
-ae.process(ae.newJCas());</programlisting></para>
- <para>This example is given as a full JUnit-based example in the the
- <emphasis>uimaFIT-examples</emphasis> project.</para>
- </section>
- <section>
- <title>Resources extending Resource_ImplBase</title>
- <para>One kind of resources extend <classname>Resource_ImplBase</classname>. These are the
- easiest to handle, because uimaFIT's version of <classname>Resource_ImplBase</classname>
- already implements the necessary logic. Just be sure to call
- <methodname>super.initialize()</methodname> when overriding
- <methodname>initialize()</methodname>. Also mind that external resources are not available
- yet when <methodname>initialize()</methodname> is called. For any initialization logic that
- requires resources, override and implement
- <methodname>afterResourcesInitialized()</methodname>. Other than that, injection of
- external resources works as usual.</para>
- <programlisting>public static class ChainableResource extends Resource_ImplBase {
- public final static String PARAM_CHAINED_RESOURCE = "chainedResource";
- @ExternalResource(key = PARAM_CHAINED_RESOURCE)
- private ChainableResource chainedResource;
-
- public void afterResourcesInitialized() {
- // init logic that requires external resources
- }
-}</programlisting>
- </section>
- <section>
- <title>Resources implementing SharedResourceObject</title>
- <para>The other kind of resources implement
- <interfacename>SharedResourceObject</interfacename>. Since this is an interface, uimaFIT
- cannot provide the initialization logic, so you have to implement a couple of things in the
- resource:</para>
- <itemizedlist>
- <listitem>
- <para>implement <interfacename>ExternalResourceAware</interfacename></para>
- </listitem>
- <listitem>
- <para>declare a configuration parameter
- <constant>ExternalResourceFactory.PARAM_RESOURCE_NAME</constant> and return its value
- in <methodname>getResourceName()</methodname></para>
- </listitem>
- <listitem>
- <para>invoke <methodname>ConfigurationParameterInitializer.initialize()</methodname> in
- the <methodname>load()</methodname> method.</para>
- </listitem>
- </itemizedlist>
- <para>Again, mind that external resource not properly initialized until uimaFIT invokes
- <methodname>afterResourcesInitialized()</methodname>.</para>
- <programlisting>public class TestSharedResourceObject implements
- SharedResourceObject, ExternalResourceAware {
-
- @ConfigurationParameter(name=ExternalResourceFactory.PARAM_RESOURCE_NAME)
- private String resourceName;
-
- public final static String PARAM_CHAINED_RESOURCE = "chainedResource";
- @ExternalResource(key = PARAM_CHAINED_RESOURCE)
- private ChainableResource chainedResource;
-
- public String getResourceName() {
- return resourceName;
- }
-
- public void load(DataResource aData)
- throws ResourceInitializationException {
-
- ConfigurationParameterInitializer.initialize(this, aData);
- // rest of the init logic that does not require external resources
- }
-
- public void afterResourcesInitialized() {
- // init logic that requires external resources
- }
-}</programlisting>
- </section>
- <section>
- <title>Note on injecting resources into resources</title>
- <para>Nested resources are only initialized if they are used in a pipeline which contains at
- least one component that calls
- <methodname>ConfigurationParameterInitializer.initialize()</methodname>. Any component
- extending uimaFIT's component base classes qualifies. If you use nested resources in a
- pipeline without any uimaFIT-aware components, you can just add uimaFIT's
- <classname>NoopAnnotator</classname> to the pipeline.</para>
- </section>
- </section>
- <section>
- <title>Resource locators</title>
- <para>Normally, in UIMA an external resource needs to implement either
- <interfacename>SharedResourceObject</interfacename> or
- <interfacename>Resource</interfacename>. In order to inject arbitrary objects, uimaFIT has
- the concept of <interfacename>ExternalResourceLocator</interfacename>. When a resource
- implements this interface, not the resource itself is injected, but the method
- <methodname>getResource()</methodname> is called on the resource and the result is injected.
- The following example illustrates how to inject an object from JNDI into a UIMA
- component:</para>
- <programlisting>class MyAnalysisEngine2 extends JCasAnnotator_ImplBase {
- static final String RES_DICTIONARY = "dictionary";
- @ExternalResource(key = RES_DICTIONARY)
- Dictionary dictionary;
-}
-
-AnalysisEngineDescription desc = createEngineDescription(
- MyAnalysisEngine2.class);
-
-bindResource(desc, MyAnalysisEngine2.RES_DICTIONARY,
- JndiResourceLocator.class,
- JndiResourceLocator.PARAM_NAME, "dictionaries/german");</programlisting>
- </section>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.gettingstarted.xml b/uimafit-docbook/src/docbook/tools.uimafit.gettingstarted.xml
deleted file mode 100644
index 3ab1dc5..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.gettingstarted.xml
+++ /dev/null
@@ -1,141 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.gettingstarted">
- <title>Getting Started</title>
-
- <para>This quick start tutorial demonstrates how to use uimaFIT to define and set a configuration
- parameter in an analysis engine, run it, and generate a descriptor file for it. The complete
- code for this example can be found in the <emphasis>uimaFIT-examples</emphasis> module.</para>
- <section>
- <title>Adding uimaFIT to your project</title>
- <para>The following instructions describe how to add uimaFIT to your project's classpath.</para>
- <section>
- <title>Maven users</title>
- <para>If you use Maven, then uimaFIT can be added to your project by simply adding uimaFIT as
- a project dependency by adding the following snippet of XML to your pom.xml file:</para>
- <programlisting><dependency>
- <groupId>org.apache.uima</groupId>
- <artifactId>uimafit-core</artifactId>
- <version><?eval ${project.version}?></version>
-</dependency></programlisting>
- <para>uimaFIT distributions are hosted by Maven Central and so no repository needs to be added
- to your pom.xml file. </para>
- </section>
- <section>
- <title>Non-Maven users</title>
- <para>If you do not build with Maven, then download uimaFIT from the <ulink
- url="http://uima.apache.org/downloads.cgi">Apache UIMA downloads page</ulink>. The file
- name should be uimafit-<?eval ${project.version}?>-bin.zip. Download and unpack this file.
- The contents of the resulting upacked directory will contain a directory called
- <filename>lib</filename>. Add all of the files in this directory to your classpath.</para>
- </section>
- </section>
-
- <section>
- <title>A simple analysis engine implementation</title>
- <para> Here is the complete analysis engine implementation for this example.</para>
-
- <programlisting format="linespecific">public class GetStartedQuickAE
- extends org.apache.uima.fit.component.JCasAnnotator_ImplBase {
-
- public static final String PARAM_STRING = "stringParam";
- @ConfigurationParameter(name = PARAM_STRING)
- private String stringParam;
-
- @Override
- public void process(JCas jCas) throws AnalysisEngineProcessException {
- System.out.println("Hello world! Say 'hi' to " + stringParam);
- }
-}</programlisting>
- <para>The first thing to note is that the member variable <varname>stringParam</varname> is
- annotated with <classname>@ConfigurationParameter</classname> which tells uimaFIT that this is
- an analysis engine configuration parameter. It is best practice to create a public constant
- for the parameter name, here <code>PARAM_STRING</code> The second thing to note is that we
- extend uimaFIT's version of the <classname>JCasAnnotator_ImplBase</classname>. The initialize
- method of this super class calls:</para>
- <programlisting format="linespecific">ConfigurationParameterInitializer.initializeConfigurationParameters(
- Object, UimaContext) </programlisting>
- <para>which populates the configuration parameters with the appropriate contents of the
- <interfacename>UimaContext</interfacename>. If you do not want to extend uimaFIT's
- <classname>JCasAnnotator_ImplBase</classname>, then you can call this method directly in the
- <methodname>initialize</methodname> method of your analysis engine or any class that
- implements <interfacename>Initializable</interfacename>. You can call this method for an
- instance of any class that has configuration parameters.</para>
- </section>
-
- <section>
- <title>Running the analysis engine</title>
- <para>The following lines of code demonstrate how to instantiate and run the analysis engine
- from a main method:</para>
- <programlisting>JCas jCas = JCasFactory.createJCas();
-
-AnalysisEngine analysisEngine = AnalysisEngineFactory.createEngine(
- GetStartedQuickAE.class,
- GetStartedQuickAE.PARAM_STRING, "uimaFIT");
-
-analysisEngine.process(jCas); </programlisting>
-
- <para>In a more involved example, we would probably instantiate a collection reader and run this
- analysis engine over a collection of documents. Here, it suffices to simply create a
- <interfacename>JCas</interfacename>. Line 3 instantiates the analysis engine using
- <classname>AnalysisEngineFactory</classname> and sets the string parameter named
- <parameter>stringParam</parameter> to the value <literal>uimaFIT</literal>. Running this
- simple program sends the following output to the console: </para>
-
- <programlisting>Hello world! Say 'hi' to uimaFIT </programlisting>
-
- <para>Normally you would be using a type system with your analysis components. When using
- uimaFIT, it is easiest to keep your type system descriptors in your source folders and make
- them known to uimaFIT. To do so, create a file
- <filename>META-INF/org.apache.uima.fit/types.txt</filename> in a source folder and add references to
- all your type descriptors to the file, one per line. You can also use wildcards. For example: </para>
-
- <programlisting>classpath*:org/apache/uima/fit/examples/type/Token.xml
-classpath*:org/apache/uima/fit/examples/type/Sentence.xml
-classpath*:org/apache/uima/fit/examples/tutorial/type/*.xml </programlisting>
- </section>
-
- <section>
- <title>Generate a descriptor file</title>
-
- <para>The following lines of code demonstrate how a descriptor file can be generated using the
- class definition:</para>
-
- <programlisting>AnalysisEngine analysisEngine = AnalysisEngineFactory.createEngine(
- GetStartedQuickAE.class,
- GetStartedQuickAE.PARAM_STRING, "uimaFIT");
-
-analysisEngineDescription.toXML(
- new FileOutputStream("GetStartedQuickAE.xml"));</programlisting>
-
- <para>If you open the resulting descriptor file you will see that the configuration parameter
- <parameter>stringParam</parameter> is defined with the value set to
- <literal>uimaFIT</literal>. We could now instantiate an analysis engine using this
- descriptor file with a line of code like this:</para>
-
- <programlisting>AnalysisEngineFactory.createEngine("GetStartedQuickAE");</programlisting>
-
- <para>But, of course, we really wouldn't want to do that now that we can instantiate analysis
- engines using the class definition as was done above!</para>
-
- <para>This chapter, of course, did not demonstrate every feature of uimaFIT which provides
- support for annotating external resources, creating aggregate engines, running pipelines,
- testing components, among others.</para>
- </section>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.introduction.xml b/uimafit-docbook/src/docbook/tools.uimafit.introduction.xml
deleted file mode 100644
index d5f9dc4..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.introduction.xml
+++ /dev/null
@@ -1,162 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.introduction">
- <title>Introduction</title>
- <para>While uimaFIT provides many features for a UIMA developer, there are two overarching themes
- that most features fall under. These two sides of uimaFIT are,while complementary, largely
- independent of each other. One of the beauties of uimaFIT is that a developer that uses one side
- of uimaFIT extensively is not required to use the other side at all. </para>
- <section>
- <title>Simplify Component Implementation</title>
- <para>The first broad theme of uimaFIT provides features that <emphasis>simplify component
- implementation</emphasis>. Our favorite example of this is the
- <classname>@ConfigurationParameter</classname> annotation which allows you to annotate a
- member variable as a configuration parameter. This annotation in combination with the method
- <methodname>ConfigurationParameterInitializer.initialize()</methodname> completely automates
- the process of initializing member variables with values from the
- <interfacename>UimaContext</interfacename> passed into your analysis engine's initialize
- method. Similarly, the annotation <classname>@ExternalResource</classname> annotation in
- combination with the method <methodname>ExternalResourceInitializer.initialize()</methodname>
- completely automates the binding of an external resource as defined in the
- <interfacename>UimaContext</interfacename> to a member variable. Dispensing with manually
- writing the code that performs these two tasks reduces effort, eliminates verbose and
- potentially buggy boiler-plate code, and makes implementing a UIMA component more enjoyable.
- Consider, for example, a member variable that is of type <classname>Locale</classname>. With
- uimaFIT you can simply annotate the member variable with
- <classname>@ConfigurationParameter</classname> and have your initialize method automatically
- initialize the variable correctly with a string value in the
- <interfacename>UimaContext</interfacename> such as <literal>en_US</literal>. </para>
- </section>
- <section>
- <title>Simplify Component Instantiation</title>
- <para>The second broad theme of uimaFIT provides features that <emphasis>simplify component
- instantiation</emphasis>. Working with UIMA, have you ever said to yourself <quote>but I
- just want to tag some text!?</quote> What does it take to <quote>just tag some text?</quote>
- Here's a list of things you must do with the traditional approach:</para>
- <itemizedlist>
- <listitem>
- <para>wrap your tagger as a UIMA analysis engine</para>
- </listitem>
- <listitem>
- <para>write a descriptor file for your analysis engine</para>
- </listitem>
- <listitem>
- <para>write a CAS consumer that produces the desired output</para>
- </listitem>
- <listitem>
- <para>write another descriptor file for the CAS consumer</para>
- </listitem>
- <listitem>
- <para>write a descriptor file for a collection reader</para>
- </listitem>
- <listitem>
- <para>write a descriptor file that describes a pipeline</para>
- </listitem>
- <listitem>
- <para>invoke the Collection Processing Manager with your pipeline descriptor file</para>
- </listitem>
- </itemizedlist>
- <section>
- <title>From a class</title>
- <para>Each of these steps has its own pitfalls and can be rather time consuming. This is a
- rather unsatisfying answer to our simple desire to just tag some text. With uimaFIT you can
- literally eliminate all of these steps. </para>
- <para>Here's a simple snippet of Java code that illustrates <quote>tagging some text</quote>
- with uimaFIT:</para>
- <programlisting>import static org.apache.uima.fit.factory.JCasFactory.createJCas;
-import static org.apache.uima.fit.pipeline.SimplePipeline.runPipeline;
-import static
- org.apache.uima.fit.factory.AnalysisEngineFactory.createEngineDescription;
-
-JCas jCas = createJCas();
-
-jCas.setDocumentText("some text");
-
-runPipeline(jCas,
- createEngineDescription(MyTokenizer.class),
- createEngineDescription(MyTagger.class));
-
-for(Token token : iterate(jCas, Token.class)){
- System.out.println(token.getTag());
-}</programlisting>
- <para>This code uses several static method imports for brevity. And while the
- terseness of this code won't make a Python programmer blush - it is certainly much easier
- than the seven steps outlined above! </para>
- </section>
- <section>
- <title>From an XML descriptor</title>
- <para>uimaFIT provides mechanisms to instantiate and run UIMA components programmatically with
- or without descriptor files. For example, if you have a descriptor file for your analysis
- engine defined by <classname>MyTagger</classname> (as shown above), then you can instead
- instantiate the analysis engine with:</para>
- <programlisting>AnalysisEngineDescription tagger = createEngineDescription(
- "mypackage.MyTagger");</programlisting>
- <para>This will find the descriptor file <filename>mypackage/MyTagger.xml</filename> by name.
- Similarly, you can find a descriptor file by location with
- <methodname>createEngineDescriptionFromPath()</methodname>. However, if you want to dispense
- with XML descriptor files altogether (and you probably do), you can use the method
- <methodname>createEngineDescription()</methodname> as shown above. One of the driving motivations
- for creating the second side of uimaFIT is our frustration with descriptor files and our
- desire to eliminate them. Descriptor files are difficult to maintain because they are
- generally tightly coupled with java code, they decay without warning, they are wearisome to
- test, and they proliferate, among other reasons.</para>
- </section>
- </section>
- <section>
- <title>Is this cheating?</title>
- <para>One question that is often raised by new uimaFIT users is whether or not it breaks the
- <emphasis>UIMA way</emphasis>. That is, does adopting uimaFIT lead me down a path of
- creating UIMA components and systems that are incompatible with the traditional UIMA approach?
- The answer to this question is <emphasis>no</emphasis>. For starters, uimaFIT does not skirt
- the UIMA mechanism of describing components - it only skips the XML part of it. For example,
- when the method <methodname>createEngineDescription()</methodname> is called (as shown above) an
- <interfacename>AnalysisEngineDescription</interfacename> is created for the analysis engine.
- This is the same object type that is instantiated when a descriptor file is used. So, instead
- of parsing XML to instantiate an analysis engine description from XML, uimaFIT uses a factory
- method to instantiate it from method parameters. One of the happy benefits of this approach is
- that for a given <interfacename>AnalysisEnginedDescription</interfacename> you can generate
- an XML descriptor file using <methodname>AnalysisEngineDescription.toXML()</methodname>. So,
- uimaFIT actually provides a very simple and direct path for <emphasis>generating</emphasis>
- XML descriptor files rather than manually creating and maintaining them! </para>
- <para>It is also useful to clarify that if you only want to use one side or the other of
- uimaFIT, then you are free to do so. This is possible precisely because uimaFIT does not
- workaround UIMA's mechanisms for describing components but rather uses them directly. For
- example, if the only thing you want to use in uimaFIT is the
- <classname>@ConfigurationParameter</classname>, then you can do so without worrying about
- what effect this will have on your descriptor files. This is because your analysis engine will
- be initialized with exactly the same <interfacename>UimaContext</interfacename> regardless of
- whether you instantiate your analysis engine in the <emphasis>UIMA way</emphasis> or use one
- of uimaFIT's factory methods. Similarly, a UIMA component does not need to be annotated with
- <classname>@ConfiguratioParameter</classname> for you to make use of the
- <methodname>createEngineDescription()</methodname> method. This is because when you pass
- configuration parameter values in to the <methodname>createEngineDescription()</methodname> method,
- they are added to an <interfacename>AnalysisEngineDescription</interfacename> which is used by
- UIMA to populate a <interfacename>UimaContext</interfacename> - just as it would if you used a
- descriptor file. </para>
- </section>
- <section>
- <title>Conclusion</title>
- <para>Because uimaFIT can be used to simplify component implementation and instantiation it is
- easy to assume that you can't do one without the other. This page has demonstrated that while
- these two sides of uimaFIT complement each other, they are not coupled together and each can
- be effectively used without the other. Similarly, by understanding how uimaFIT uses the UIMA
- component description mechanisms directly, one can be assured that uimaFIT enables UIMA
- development that is compatible and consistent with the UIMA standard and APIs. </para>
- </section>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.maven.xml b/uimafit-docbook/src/docbook/tools.uimafit.maven.xml
deleted file mode 100644
index a41d141..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.maven.xml
+++ /dev/null
@@ -1,190 +0,0 @@
-<?xml version="1.0" encoding="UTF-8"?>
-<!DOCTYPE chapter PUBLIC "-//OASIS//DTD DocBook XML V4.4//EN"
-"http://www.oasis-open.org/docbook/xml/4.4/docbookx.dtd"[
-<!ENTITY imgroot "images/tools/tools.jcasgen/" >
-<!ENTITY % uimaents SYSTEM "../../target/docbook-shared/entities.ent" >
-%uimaents;
-]>
-<!--
-Licensed to the Apache Software Foundation (ASF) under one
-or more contributor license agreements. See the NOTICE file
-distributed with this work for additional information
-regarding copyright ownership. The ASF licenses this file
-to you under the Apache License, Version 2.0 (the
-"License"); you may not use this file except in compliance
-with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing,
-software distributed under the License is distributed on an
-"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-KIND, either express or implied. See the License for the
-specific language governing permissions and limitations
-under the License.
--->
-<chapter id="tools.uimafit.maven">
- <title>uimaFIT Maven Plugin</title>
-
- <para>uimaFIT dynamically generates UIMA component descriptions from annotations in the Java
- source code. The uimaFIT Maven plugin provides the ability to automatically create such
- annotations in already compiled classes and to automatically generate XML descriptors from the
- annotated classes.</para>
- <section>
- <title>enhance goal</title>
- <para>The goal enhance allows automatically augmenting compiled classes with uimaFIT
- annotations. Information like vendor, copyright, or version can be obtained from the Maven
- POM. Additionally, descriptions for parameters and components can be generated from Javadoc
- comments. Existing annotations are not overwritten unless forced. </para>
- <programlisting><plugin>
- <groupId>org.apache.uima</groupId>
- <artifactId>uimafit-maven-plugin</artifactId>
- <version><?eval ${project.version}?></version> <!-- change to latest version -->
- <configuration>
- <!-- OPTIONAL -->
- <!-- Override component description in generated descriptors. -->
- <overrideComponentDescription>false</overrideComponentDescription>
-
- <!-- OPTIONAL -->
- <!-- Override version in generated descriptors. -->
- <overrideComponentVersion>false</overrideComponentVersion>
-
- <!-- OPTIONAL -->
- <!-- Override vendor in generated descriptors. -->
- <overrideComponentVendor>false</overrideComponentVendor>
-
- <!-- OPTIONAL -->
- <!-- Override copyright in generated descriptors. -->
- <overrideComponentCopyright>false</overrideComponentCopyright>
-
- <!-- OPTIONAL -->
- <!-- Version to use in generated descriptors. -->
- <componentVersion>${project.version}</componentVersion>
-
- <!-- OPTIONAL -->
- <!-- Vendor to use in generated descriptors. -->
- <componentVendor>Apache Foundation</componentVendor>
-
- <!-- OPTIONAL -->
- <!-- Copyright to use in generated descriptors. -->
- <componentCopyright>Apache Foundation 2013</componentCopyright>
-
- <!-- OPTIONAL -->
- <!-- Source file encoding. -->
- <encoding>${project.build.sourceEncoding}</encoding>
-
- <!-- OPTIONAL -->
- <!-- Generate a report of missing meta data in
- $project.build.directory/uimafit-missing-meta-data-report.txt -->
- <generateMissingMetaDataReport>true</generateMissingMetaDataReport>
-
- <!-- OPTIONAL -->
- <!-- Fail on missing meta data. This setting has no effect unless
- generateMissingMetaDataReport is enabled. -->
- <failOnMissingMetaData>false</failOnMissingMetaData>
-
- <!-- OPTIONAL -->
- <!-- Constant name prefixes used for parameters and external resources,
- e.g. "PARAM_". -->
- <parameterNameConstantPrefixes>
- <prefix>PARAM_<prefix/>
- </parameterNameConstantPrefixes>
-
- <!-- OPTIONAL -->
- <!-- Fail on missing meta data. This setting has no effect unless
- generateMissingMetaDataReport is enabled. -->
- <externalResourceNameConstantPrefixes>
- <prefix>KEY_<prefix/>
- <prefix>RES_<prefix/>
- </externalResourceNameConstantPrefixes>
-
- <!-- OPTIONAL -->
- <!-- Mode of adding type systems found on the classpath via the
- uimaFIT detection mechanism at compile time to the generated
- descriptor. By default, no type systems are added. -->
- <addTypeSystemDescriptions>NONE</addTypeSystemDescriptions>
-
- </configuration>
- <executions>
- <execution>
- <id>default</id>
- <phase>process-classes</phase>
- <goals>
- <goal>enhance</goal>
- </goals>
- </execution>
- </executions>
-</plugin></programlisting>
- <para>When generating descriptions for configuration parameters or external resources, the
- plugin supports a common practice of placing the Javadoc on a constant field instead of the
- parameter or external resource field. Per default, parameter name constants must be prefixed
- with <code>PARAM_</code> and external resource key constants must be prefixed with <code>RES_
- </code>or <code>KEY_</code>.</para>
- <programlisting>/**
- * Enable or disable my feature.
- */
-public static final String PARAM_ENABLE_FEATURE = "enableFeature";
-@ConfigurationParameter(name=PARAM_ENABLE_FEATURE)
-private boolean enableFeature;
-
-/**
- * My external resource.
- */
-public static final String RES_MY_RESOURCE = "resource";
-@ExternalResource(key=RES_MY_RESOURCE)
-private MyResource resource;</programlisting>
- <para>By enabling <code>generateMissingMetaDataReport</code>, the build can be made to fail if
- meta data such as parameter descriptions are missing. A report about the missing data is
- generated in <filename>uimafit-missing-meta-data-report.txt</filename> in the project build
- directory.</para>
- </section>
- <section>
- <title>generate goal</title>
- <para>The generate goal generates XML component descriptors for UIMA components. </para>
- <programlisting><plugin>
- <groupId>org.apache.uima</groupId>
- <artifactId>uimafit-maven-plugin</artifactId>
- <version><?eval ${project.version}?></version> <!-- change to latest version -->
- <configuration>
- <!-- OPTIONAL -->
- <!-- Path where the generated resources are written. -->
- <outputDirectory>
- ${project.build.directory}/generated-sources/uimafit
- </outputDirectory>
-
- <!-- OPTIONAL -->
- <!-- Skip generation of META-INF/org.apache.uima.fit/components.txt -->
- <skipComponentsManifest>false</skipComponentsManifest>
-
- <!-- OPTIONAL -->
- <!-- Source file encoding. -->
- <encoding>${project.build.sourceEncoding}</encoding>
- </configuration>
- <executions>
- <execution>
- <id>default</id>
- <phase>process-classes</phase>
- <goals>
- <goal>generate</goal>
- </goals>
- </execution>
- </executions>
-</plugin></programlisting>
- <para>In addition to the XML descriptors, a manifest file is written to
- <filename>META-INF/org.apache.uima.fit/components.txt</filename>. This file can be used to
- conveniently locate the XML descriptors, which are written in the packages next to the classes
- they
- describe.<programlisting>classpath*:org/apache/uima/fit/examples/ExampleComponent.xml</programlisting></para>
- <para>It is recommended to use both, the enhance and the generate goal. Both goals should be
- specified in the same execution, first enhance, then generate:</para>
- <programlisting><execution>
- <id>default</id>
- <phase>process-classes</phase>
- <goals>
- <goal>enhance</goal>
- <goal>generate</goal>
- </goals>
-</execution></programlisting>
- </section>
-
-</chapter>
\ No newline at end of file
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.migration.xml b/uimafit-docbook/src/docbook/tools.uimafit.migration.xml
deleted file mode 100644
index b804137..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.migration.xml
+++ /dev/null
@@ -1,226 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.migration">
- <title>Migration Guide</title>
- <para>This section provides helpful information on incompatible changes between versions.</para>
- <section>
- <title>Version 2.3.0 to 2.4.0</title>
- <formalpara>
- <title>Version requirements</title>
- <para>Depends on UIMA 2.10.2, Spring Framework 3.2.16 and Java 7.</para>
- </formalpara>
- <formalpara>
- <para>Mind the updated version requirements. There should be no other potentially problematic
- changes in this upgrade.</para>
- </formalpara>
- </section>
- <section>
- <title>Version 2.2.0 to 2.3.0</title>
- <formalpara>
- <title>CasIOUtil deprecated</title>
- <para>The functionality of the uimaFIT CasIOUtil class has been superseded by the core UIMA
- class CasIOUtils added in UIMA 2.9.0. The method signatures in the new class are not the
- same, but provide more functionality. CasIOUtil has been deprecated and documentation has
- been added which of the CasIOUtils methods should be used instead.</para>
- </formalpara>
- <formalpara>
- <title>Version requirements</title>
- <para>Depends on UIMA 2.9.1, Spring Framework 3.2.16 and Java 7.</para>
- </formalpara>
- <formalpara>
- <para>Mind the updated version requirements. There should be no other potentially problematic
- changes in this upgrade.</para>
- </formalpara>
- </section>
- <section>
- <title>Version 2.1.0 to 2.2.0</title>
- <formalpara>
- <title>Version requirements</title>
- <para>Depends on UIMA 2.8.1, Spring Framework 3.2.16 and Java 7.</para>
- </formalpara>
- <formalpara>
- <para>Mind the updated version requirements. There should be no other potentially problematic
- changes in this upgrade.</para>
- </formalpara>
- </section>
- <section>
- <title>Version 2.0.0 to 2.1.0</title>
- <formalpara>
- <title>Version requirements</title>
- <para>Depends on UIMA 2.6.0 and Java 6.</para>
- </formalpara>
- <formalpara>
- <title>AnnotationFactory.createAnnotation()</title>
- <para>No longer throws <literal>UIMAExcption</literal>. If this exception was cought, some
- IDEs may complain here after upgrading to uimaFIT 2.1.0. </para>
- </formalpara>
- </section>
- <section>
- <title>Version 1.4.0 to 2.0.0</title>
- <formalpara>
- <title>Version requirements</title>
- <para>Depends on UIMA 2.4.2.</para>
- </formalpara>
- <formalpara>
- <title>Backwards compatibility</title>
- <para>Compatibility with legacy annotation is provided by the Legacy support module.</para>
- </formalpara>
- <formalpara>
- <title>Change of Maven groupId and artifactId</title>
- <para>The Maven group ID has changed from <literal>org.uimafit</literal> to
- <literal>org.apache.uima</literal>.</para>
- </formalpara>
- <para>The artifact ID of the main uimaFIT artifact has been changed from
- <literal>uimafit</literal> to <literal>uimafit-core</literal>.</para>
- <formalpara>
- <title>Change of package names</title>
- <para>The base package has been renamed from <literal>org.uimafit</literal> to
- <literal>org.apache.uima.fit</literal>. A global search/replace on Java files with for
- lines starting with <literal>import org.uimafit</literal> and replacing that with
- <literal>import org.apache.uima.fit</literal> should work.</para>
- </formalpara>
- <formalpara>
- <title>@ConfigurationParameter</title>
- <para>The default value for the mandatory attribute now is <literal>true</literal>. The
- default name of configuration parameters is now the name of the annotated field only. The
- classname is no longer prefixed. The method
- <code>ConfigurationParameterFactory.createConfigurationParameterName()</code> that was
- used to generate the prefixed name has been removed.</para>
- </formalpara>
- <formalpara>
- <title>Type detection: META-INF/org.uimafit folder</title>
- <para>The <literal>META-INF/org.uimafit</literal> was renamed to
- <literal>META-INF/org.apache.uima.fit</literal>.</para>
- </formalpara>
- <formalpara>
- <title>JCasUtil</title>
- <para>The deprecated <code>JCasUtil.iterate()</code> methods have been removed.
- <code>JCasUtil.select()</code> should be used instead.</para>
- </formalpara>
- <formalpara>
- <title>AnalysisEngineFactory</title>
- <para>All <literal>createAggregateXXX</literal> and <literal>createPrimitiveXXX</literal>
- methods have been renamed to <literal>createEngineXXX</literal>. The old names are
- deprecated and will be removed in future versions.</para>
- </formalpara>
- <para>All <literal>createAnalysisEngineXXX</literal> methods have been renamed to
- <literal>createEngineXXX</literal>. The old names are deprecated and will be removed in
- future versions.</para>
- <formalpara>
- <title>CollectionReaderFactory</title>
- <para>All <literal>createDescriptionXXX</literal> methods have been renamed to
- <literal>createReaderDescriptionXXX</literal>. The old names are deprecated and will be
- removed in future versions.</para>
- </formalpara>
- <para>All <literal>createCollectionReaderXXX</literal> methods have been renamed to
- <literal>createReaderXXX</literal>. The old names are deprecated and will be removed in
- future versions.</para>
- <formalpara>
- <title>JCasIterable</title>
- <para><code>JCasIterable</code> now only accepts reader and engine descriptions (no instances)
- and no longer implements the <code>Iterator</code> interface. Instead, new
- <code>JCasIterator</code> has been added, which replaces <code>JCasIterable</code> in that
- respect.</para>
- </formalpara>
- <formalpara>
- <title>CasDumpWriter</title>
- <para><literal>org.uimafit.component.xwriter.CASDumpWriter</literal> has been renamed to
- <literal>org.apache.uima.fit.component.CasDumpWriter</literal>.</para>
- </formalpara>
- <formalpara>
- <title>CpePipeline</title>
- <para><literal>CpePipeline</literal> has been moved to a separate module with the artifact ID
- <literal>uimafit-cpe</literal> to reduce the dependencies incurred by the main uimaFIT
- artifact.</para>
- </formalpara>
- <formalpara>
- <title>XWriter removed</title>
- <para>The <literal>XWriter</literal> and associated file namers have been removed as they were
- much more complex then acutally needed. As an alternative, <literal>CasIOUtil</literal> has
- been introduced providing several convenience methods to read/write JCas/CAS data. </para>
- </formalpara>
- <formalpara>
- <title>JCasFactory</title>
- <para>Methods only loading JCas data have been removed from <literal>JCasFactory</literal>.
- The new methods in <literal>CasIOUtil</literal> can be used instead.</para>
- </formalpara>
- </section>
- <section>
- <title>Legacy support module</title>
- <para>The compatibility layer should allow you to migrate to uimaFIT <?eval ${project.version}?> without breaking
- anything. You should then be able to gradually change the codebase to be compatible with
- uimaFIT <?eval ${project.version}?>. As far as my tests go, uimaFIT 1.x and <?eval ${project.version}?> can coexist peacefully on the
- classpath (and indeed both need to be on the classpath in order to use the legacy support
- module).</para>
- <para>To enable the legacy support, make sure that you have a dependency on uimaFIT 1.x and then
- just add a dependency on the legacy module:</para>
- <programlisting><dependency>
- <groupId>org.uimafit</groupId>
- <artifactId>uimafit</artifactId>
- <version>1.4.0</version>
-</dependency>
-<dependency>
- <groupId>org.apache.uima</groupId>
- <artifactId>uimafit-legacy-support</artifactId>
- <version><?eval ${project.version}?></version>
-</dependency></programlisting>
- <para>uimaFIT <?eval ${project.version}?> automatically detects the presence of the legacy module and uses it - no
- additional configuration is necessary.</para>
- <para>The following bash script may help to partially automatize the source code migration process.
- Please observe that it does not cover all of the necessary changes!</para>
- <note>
- <para>The script recursively changes all files under the current working directory! Make
- sure you are in the right directory before running it! <emphasis>Use the script at your own
- risk!</emphasis></para>
- </note>
- <programlisting>#!/bin/sh
-
-############################################
-# MAKE SURE TO BACKUP YOUR FILES FIRST!
-# SCRIPT RECURSIVELY CHANGES ALL JAVA FILES!
-# USE AT YOUR OWN RISK!
-############################################
-
-# Change of package names
-find . -name '*.java' -print |
-xargs perl -p -i -e 's/org.uimafit/org.apache.uima.fit/g'
-
-find . -name '*.java' -print |
-xargs perl -p -i -e 's/org.uimafit.component.xwriter.CASDumpWriter/\
-org.apache.uima.fit.component.CasDumpWriter/g'
-
-# AnalysisEngineFactory
-find . -name '*.java' -print |
-xargs perl -p -i -e 's/createAggregate/createEngine/g'
-
-find . -name '*.java' -print |
-xargs perl -p -i -e 's/createPrimitive/createEngine/g'
-
-find . -name '*.java' -print |
-xargs perl -p -i -e 's/createAnalysisEngine/createEngine/g'
-
-# Readers
-find . -name '*.java' -print |
-xargs perl -p -i -e 's/createDescription/createReaderDescription/g'
-
-find . -name '*.java' -print |
-xargs perl -p -i -e 's/createCollectionReader/createReader/g'
-</programlisting>
- </section>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.packaging.xml b/uimafit-docbook/src/docbook/tools.uimafit.packaging.xml
deleted file mode 100644
index b0a0b53..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.packaging.xml
+++ /dev/null
@@ -1,105 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.packaging">
- <title>Building an executable JAR</title>
- <para>Building an executable JAR including uimaFIT components typically requires extra care. Per
- convention, uimaFIT expects certain information in specific locations on the classpath, e.g. the
- <filename>types.txt</filename> file that controls the <link
- linkend="ugr.tools.uimafit.packaging">automatic type system detection</link> mechanism must
- reside at <filename>META-INF/org.apache.uima.fit/types.txt</filename>. It often occurs that a
- project has several dependencies, each supplying its own configuration files at these standard
- locations. However, this causes a problem with naive approaches to creating an executable
- <emphasis>fat-jar</emphasis> merging all dependencies into a single JAR file. Without extra
- care, the files supplied by the different dependencies overwrite each other during the packaging
- process and only one file <emphasis>wins</emphasis> in the end. As a consequence, the types
- configured in the other files cannot be detected at runtime. Such a native approach is taken,
- for example, by the Maven Assembly Plugin.</para>
- <para>The Maven Shade Plugin provides a convenient alternative for the creation of executable
- fat-jars, as it provides a mechanism to concatenate the configuration files from different
- dependencies while creating the fat-jar. To use the Maven Shade Plugin with uimaFIT, use the
- following configuration section in your POM file and make sure to change the
- <parameter>mainClass</parameter> as required for your project:</para>
- <programlisting><build>
- <plugins>
- <plugin>
- <groupId>org.apache.maven.plugins</groupId>
- <artifactId>maven-shade-plugin</artifactId>
- <version>2.2</version>
- <executions>
- <execution>
- <phase>package</phase>
- <goals><goal>shade</goal></goals>
- <configuration>
- <transformers>
- <!-- Set the main class of the executable JAR -->
- <transformer
- implementation="org.apache.maven.plugins.shade.\
- resource.ManifestResourceTransformer">
- <mainClass>org.apache.uima.fit.example.Main</mainClass>
- </transformer>
- <!-- Merge the uimaFIT configuration files -->
- <transformer
- implementation="org.apache.maven.plugins.shade.\
- resource.AppendingTransformer">
- <resource>\
- META-INF/org.apache.uima.fit/fsindexes.txt\
- </resource>
- </transformer>
- <transformer
- implementation="org.apache.maven.plugins.shade.\
- resource.AppendingTransformer">
- <resource>\
- META-INF/org.apache.uima.fit/types.txt\
- </resource>
- </transformer>
- <transformer
- implementation="org.apache.maven.plugins.shade.\
- resource.AppendingTransformer">
- <resource>\
- META-INF/org.apache.uima.fit/typepriorities.txt\
- </resource>
- </transformer>
- </transformers>
- <!--
- Prevent huge shaded artifacts from being deployed
- to a Maven repository (remove if not desired)
- -->
- <outputFile>\
- ${project.build.directory}/\
- ${artifactId}-${version}-standalone.jar\
- </outputFile>
- </configuration>
- </execution>
- </executions>
- </plugin>
- </plugins>
-</build></programlisting>
- <note>
- <para>Due to formatting constraints in the PDF version of this manual, the example above uses
- <code>\</code> to indicate a line continuation. Remove these and join the lines when you
- copy/paste this example.</para>
- </note>
- <note>
- <para>You might want to consider also merging additional files, such as LICENSE, NOTICE, or
- DEPENDENCY files, configuration files for the Java Service Locator API, or files used by
- other frameworks that uses similar conventions for configuration file locations. Check the
- documentation of the Maven Shade Plugin, as different kinds of configuration files require
- different specialized transformers.</para>
- </note>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.pipelines.xml b/uimafit-docbook/src/docbook/tools.uimafit.pipelines.xml
deleted file mode 100644
index 6a89eb4..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.pipelines.xml
+++ /dev/null
@@ -1,73 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.pipelines">
- <title>Pipelines</title>
- <para>UIMA is a component-based architecture that allows composing various processing components
- into a complex processing pipeline. A pipeline typically involves a <emphasis>collection
- reader</emphasis> which ingests documents and <emphasis>analysis engines</emphasis> that do
- the actual processing.</para>
- <para>Normally, you would run a pipeline using a UIMA Collection Processing Engine or using UIMA
- AS. uimaFIT offers a third alternative that is much simpler to use and well suited for embedding
- UIMA pipelines into applications or for writing tests.</para>
- <para>As uimaFIT does not supply any readers or processing components, we just assume that we have
- written three components:</para>
- <itemizedlist>
- <listitem>
- <para><classname>TextReader</classname> - reads text files from a directory</para>
- </listitem>
- <listitem>
- <para><classname>Tokenizer</classname> - annotates tokens</para>
- </listitem>
- <listitem>
- <para><classname>TokenFrequencyWriter</classname> - writes a list of tokens and their
- frequency to a file</para>
- </listitem>
- </itemizedlist>
- <para>We create descriptors for all components and run them as a pipeline:</para>
- <programlisting>CollectionReaderDescription reader =
- CollectionReaderFactory.createReaderDescription(
- TextReader.class,
- TextReader.PARAM_INPUT, "/home/uimafit/documents");
-
-AnalysisEngineDescription tokenizer =
- AnalysisEngineFactory.createEngineDescription(
- Tokenizer.class);
-
-AnalysisEngineDescription tokenFrequencyWriter =
- AnalysisEngineFactory.createEngineDescription(
- TokenFrequencyWriter.class,
- TokenFrequencyWriter.PARAM_OUTPUT, "counts.txt");
-
-SimplePipeline.runPipeline(reader, tokenizer, writer);</programlisting>
- <para>Instead of running the full pipeline end-to-end, we can also process one document at a time
- and inspect the analysis results:</para>
- <programlisting>CollectionReaderDescription reader =
- CollectionReaderFactory.createReaderDescription(
- TextReader.class,
- TextReader.PARAM_INPUT, "/home/uimafit/documents");
-
-AnalysisEngineDescription tokenizer =
- AnalysisEngineFactory.createEngineDescription(
- Tokenizer.class);
-
-for (JCas jcas : SimplePipeline.iteratePipeline(reader, tokenizer)) {
- System.out.printf("Found %d tokens%n",
- JCasUtil.select(jcas, Token.class).size());
-}</programlisting>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.testing.xml b/uimafit-docbook/src/docbook/tools.uimafit.testing.xml
deleted file mode 100644
index 6b7e704..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.testing.xml
+++ /dev/null
@@ -1,105 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.introduction">
- <title>Testing UIMA components</title>
- <para>Writing tests without uimaFIT can be a laborious process that results in fragile tests that
- are very verbose and break easily when code is refactored. This page demonstrates how you can
- write tests that are both concise and robust. Here's an outline of how you might create a test
- for a UIMA component <emphasis>without</emphasis> uimaFIT:</para>
- <orderedlist>
- <listitem>
- <para>write a descriptor file that configures your component appropriately for the test. This
- requires a minimum of 30-50 lines of XML.</para>
- </listitem>
- <listitem>
- <para>begin a test with 5-10 lines of code that instantiate the e.g. analysis engine.</para>
- </listitem>
- <listitem>
- <para>run the analysis engine against some text and test the contents of the CAS.</para>
- </listitem>
- <listitem>
- <para>repeat steps 1-3 for your next test usually by copying the descriptor file, renaming it,
- and changing e.g. configuration parameters.</para>
- </listitem>
- </orderedlist>
- <para>If you have gone through the pain of creating tests like these and then decided you should
- refactor your code, then you know how tedious it is to maintain them. </para>
- <para>Instead of pasting variants of the setup code (see step 2) into other tests we began to
- create a library of utility methods that we could call which helped shorten our code. We
- extended these methods so that we could instantiate our components directly without a descriptor
- file. These utility methods became the initial core of uimaFIT. </para>
- <section>
- <title>Examples</title>
- <para>There are several examples that can be found in the <emphasis>uimafit-examples</emphasis>
- module.</para>
- <itemizedlist>
- <listitem>
- <para>There are a number of examples of unit tests in both the test suite for the uimafit
- project and the uimafit-examples project. In particular, there are some well-documented
- unit tests in the latter which can be found in
- <classname>RoomNumberAnnotator1Test</classname></para>
- </listitem>
- <listitem>
- <para>You can improve your testing strategy by introducing a <classname>TestBase</classname>
- class such as the one found in <classname>ExamplesTestBase</classname>. This class is
- intended as a super class for your other test classes and sets up a
- <interfacename>JCas</interfacename> that is always ready to use along with a
- <interfacename>TypeSystemDescription</interfacename> and a
- <interfacename>TypePriorities</interfacename>. An example test that subclasses from
- <classname>ExamplesTestBase</classname> is
- <classname>RoomNumberAnnotator2Test</classname>.</para>
- </listitem>
- <listitem>
- <para>Most analysis engines that you want to test will generally be downstream of many other
- components that add annotations to the CAS. These annotations will likely need to be in
- the CAS so that a downstream analysis engine will do something sensible. This poses a
- problem for tests because it may be undesirable to set up and run an entire pipeline every
- time you want to test a downstream analysis engine. Furthermore, such tests can become
- fragile in the face of behavior changes to upstream components. For this reason, it can be
- advantageous to serialize a CAS as an XMI file and use this as a starting point rather
- than running an entire pipeline. An example of this approach can be found in
- <classname>XmiTest</classname>. </para>
- </listitem>
- </itemizedlist>
- </section>
- <section>
- <title>Tips & Tricks</title>
- <para>The package <package>org.apache.uima.fit.testing</package> provides some utility classes
- that can be handy when writing tests for UIMA components. You may find the following
- suggestions useful:</para>
- <itemizedlist>
- <listitem>
- <para>add a <classname>TokenBuilder</classname> to your <classname>TestBase</classname>
- class. An example of this can be found in <classname>ComponentTestBase</classname>. This
- makes it easy to add tokens and sentences to the CAS you are testing which is a common
- task for many tests.</para>
- </listitem>
- <listitem>
- <para>use a <classname>JCasBuilder</classname> to add text and annotations incrementally to
- a JCas instead of first setting the text and then adding all annotations. </para>
- </listitem>
- <listitem>
- <para>use a <classname>CasDumpWriter</classname> to write the CAS contents is a human
- readable format to a file or to the console. Compare this with a previously written and
- manually verifed file to see if changes in the component result in changes of the
- components output.</para>
- </listitem>
- </itemizedlist>
- </section>
-</chapter>
diff --git a/uimafit-docbook/src/docbook/tools.uimafit.typesystem.xml b/uimafit-docbook/src/docbook/tools.uimafit.typesystem.xml
deleted file mode 100644
index 4c3443d..0000000
--- a/uimafit-docbook/src/docbook/tools.uimafit.typesystem.xml
+++ /dev/null
@@ -1,163 +0,0 @@
-<!--
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<chapter id="ugr.tools.uimafit.typesystem">
- <title>Type System Detection</title>
- <para>UIMA requires that types that are used in the CAS are defined in XML files - so-called
- <emphasis>type system descriptions</emphasis> (TSD). Whenever a UIMA component is created, it
- must be associated with such a type system. While it is possible to manually load the type
- system descriptors and pass them to each UIMA component and to each created CAS, it is quite
- inconvenient to do so. For this reason, uimaFIT supports the automatic detection of such files
- in the classpath. Thus is becomes possible for a UIMA component provider to have component's
- type automatically detected and thus the components becomes immediately usable by adding it to
- the classpath.</para>
- <section>
- <title>Making types auto-detectable</title>
- <para>The provider of a type system should create a file
- <filename>META-INF/org.apache.uima.fit/types.txt</filename> in the classpath. This file
- should define the locations of the type system descriptions. Assume that a type
- <classname>org.apache.uima.fit.type.Token</classname> is specified in the TSD
- <filename>org/apache/uima/fit/type/Token.xml</filename>, then the file should have the
- following contents:</para>
- <programlisting>classpath*:org/apache/uima/fit/type/Token.xml</programlisting>
- <note>
- <para>Mind that the file <filename>types.txt</filename> is must be located in
- <filename>META-INF/org.apache.uima.fit</filename> where
- <filename>org.apache.uima.fit</filename> is the name of a sub-directory inside
- <filename>META-INF</filename>. <emphasis>We are not using the Java package notation
- here!</emphasis></para>
- </note>
- <para>To specify multiple TSDs, add additonal lines to the file. If you have a large number of
- TSDs, you may prefer to add a pattern. Assume that we have a large number of TSDs under
- <filename>org/apache/uima/fit/type</filename>, we can use the following pattern which
- recursively scans the package <package>org.apache.uima.fit.type</package> and all sub-packages
- for XML files and tries to load them as TSDs.</para>
- <programlisting>classpath*:org/apache/uima/fit/type/**/*.xml</programlisting>
- <para>Try to design your packages structure in a way that TSDs and JCas wrapper classes
- generated from them are separate from the rest of your code.</para>
- <para>If it is not possible or inconvenient to add the `types.txt` file, patterns can also be
- specified using the system property
- <parameter>org.apache.uima.fit.type.import_pattern</parameter>. Multiple patterns may be
- specified separated by semicolon:</para>
- <programlisting>-Dorg.apache.uima.fit.type.import_pattern=\
- classpath*:org/apache/uima/fit/type/**/*.xml</programlisting>
- <note>
- <para>The <literal>\</literal> in the example is used as a line-continuation indicator. It
- and all spaces following it should be ommitted.</para>
- </note>
- </section>
- <section>
- <title>Making index definitions and type priorities auto-detectable</title>
- <para>Auto-detection also works for index definitions and type priority definitions. For
- index definitions, the respective file where to register the index definition XML files is
- <filename>META-INF/org.apache.uima.fit/fsindexes.txt</filename> and for type priorities, it
- is <filename>META-INF/org.apache.uima.fit/typepriorities.txt</filename>.</para>
- </section>
- <section>
- <title>Using type auto-detection </title>
- <para>The auto-detected type system can be obtained from the
- <classname>TypeSystemDescriptionFactory</classname>:</para>
- <programlisting>TypeSystemDescription tsd =
- TypeSystemDescriptionFactory.createTypeSystemDescription()</programlisting>
- <para>Popular factory methods also support auto-detection:</para>
- <programlisting>AnalysisEngine ae = createEngine(MyEngine.class);</programlisting>
- </section>
- <section>
- <title>Multiple META-INF/org.apache.uima.fit/types.txt files</title>
- <para>uimaFIT supports multiple <filename>types.txt</filename> files in the classpath (e.g. in differnt JARs). The
- <filename>types.txt</filename> files are located via Spring using the classpath search
- pattern: </para>
- <programlisting>TYPE_MANIFEST_PATTERN = "classpath*:META-INF/org.apache.uima.fit/types.txt" </programlisting>
- <para>This resolves to a list URLs pointing to ALL <filename>types.txt</filename> files. The
- resolved URLs are unique and will point either to a specific point in the file system or into
- a specific JAR. These URLs can be handled by the standard Java URL loading mechanism.
- Example:</para>
- <programlisting>jar:/path/to/syntax-types.jar!/META-INF/org.apache.uima.fit/types.txt
-jar:/path/to/token-types.jar!/META-INF/org.apache.uima.fit/types.txt</programlisting>
- <para>uimaFIT then reads all patters from all of these URLs and uses these to search the
- classpath again. The patterns now resolve to a list of URLs pointing to the individual type
- system XML descriptors. All of these URLs are collected in a set to avoid duplicate loading
- (for performance optimization - not strictly necessary because the UIMA type system merger can
- handle compatible duplicates). Then the descriptors are loaded into memory and merged using
- the standard UIMA type system merger
- (<methodname>CasCreationUtils.mergeTypeSystems()</methodname>). Example:</para>
- <programlisting>jar:/path/to/syntax-types.jar!/desc/types/Syntax.xml
-jar:/path/to/token-types.jar!/org/foobar/typesystems/Tokens.xml </programlisting>
- <para>Voilá, the result is a type system covering all types could be found in the
- classpath.</para>
- <para>It is recommended <orderedlist>
- <listitem>
- <para>to put type system descriptors into packages resembling a namespace you "own" and to
- use a package-scoped wildcard
- search<programlisting>classpath*:org/apache/uima/fit/type/**/*.xml`</programlisting></para>
- </listitem>
- <listitem>
- <para>or when putting descriptors into a "well-known" package like
- <package>desc.type</package>, that <filename>types.txt</filename> file should
- explicitly list all type system descriptors instead of using a wildcard
- search<programlisting>classpath*:desc/type/Token.xml
-classpath*:desc/type/Syntax.xml </programlisting></para>
- </listitem>
- </orderedlist>Method 1 should be preferred. Both methods can be mixed. </para>
- </section>
- <section>
- <title>Performance note and caching</title>
- <para>Currently uimaFIT evaluates the patterns for TSDs once and caches the locations, but not
- the actual merged type system description. A rescan can be forced using
- <methodname>TypeSystemDescriptionFactory.forceTypeDescriptorsScan()</methodname>. This may
- change in future.</para>
- </section>
- <section>
- <title>Potential problems</title>
- <para>The mechanism works fine. However, there are specific issues with Java in general that one
- should be aware of.</para>
- <section>
- <title>m2eclipse fails to copy descriptors to target/classes</title>
- <para>There seems to be a bug in some older versions of m2eclipse that causes resources not
- always to be copied to <filename>target/classes</filename>. If UIMA complains about type
- definitions missing at runtime, try to <emphasis>clean/rebuild</emphasis> your project and
- carefully check the m2eclipse console in the console view for error messages that might
- cause m2eclipse to abort.</para>
- </section>
- <section>
- <title>Class version conflicts</title>
- <para>A problem can occur if you end up having multiple incompatible versions of the same type
- system in the classpath. This is a general problem and not related to the auto-detection
- feature. It is the same as when you have incompatible version of a particular class (e.g.
- <interfacename>JCas</interfacename> wrapper or some third-party-library) in the classpath.
- The behavior of the Java Classloader is undefined in that case. The detection will do its
- best to try and load everything it can find, but the UIMA type system merger may barf or you
- may end up with undefined behavior at runtime because one of the class versions is used at
- random. </para>
- </section>
- <section>
- <title>Classes and resources in the default package</title>
- <para>It is bad practice to place classes into the default (unnamed) package. In fact it is
- not possible to import classes from the default package in another class. Similarly it is a
- bad idea to put resources at the root of the classpath. The Spring documentation on
- resources <ulink
- url="http://static.springsource.org/spring/docs/3.0.x/reference/resources.html#resources-app-ctx-wildcards-in-resource-paths"
- >explains this in detail</ulink>.</para>
- <para>For this reason the <filename>types.txt</filename> resides in
- <filename>/META-INF/org.apache.uima.fit</filename> and it is suggest that type system
- descriptors reside either in a proper package like
- <filename>/org/foobar/typesystems/XXX.xml</filename> or in
- <filename>/desc/types/XXX.xml</filename>. </para>
- </section>
- </section>
-</chapter>