You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by da...@apache.org on 2021/09/14 08:35:49 UTC
[camel] branch main updated: CAMEL-16861: Polished tokenize language
This is an automated email from the ASF dual-hosted git repository.
davsclaus pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/camel.git
The following commit(s) were added to refs/heads/main by this push:
new 708c76a CAMEL-16861: Polished tokenize language
708c76a is described below
commit 708c76a96ae0eaa880e45b62d97ee8af2f7716c5
Author: Claus Ibsen <cl...@gmail.com>
AuthorDate: Tue Sep 14 10:34:41 2021 +0200
CAMEL-16861: Polished tokenize language
---
.../docs/modules/languages/pages/tokenize-language.adoc | 15 +++++++++------
1 file changed, 9 insertions(+), 6 deletions(-)
diff --git a/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc b/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc
index 97f118c..b072b00 100644
--- a/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc
+++ b/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc
@@ -9,17 +9,18 @@ include::{cq-version}@camel-quarkus:ROOT:partial$reference/languages/tokenize.ad
*Since Camel {since}*
-The tokenizer language is a built-in language in camel-core, which is
-most often used with the Splitter EIP to split
-a message using a token-based strategy.
+The tokenizer language is a built-in language in `camel-core`, which is
+most often used with the xref:{eip-vc}:eips:split-eip.adoc[Split] EIP
+to split a message using a token-based strategy.
The tokenizer language is intended to tokenize text documents using a
specified delimiter pattern. It can also be used to tokenize XML
documents with some limited capability. For a truly XML-aware
-tokenization, the use of the XMLTokenizer
+tokenization, the use of the xref:xtokenize-language.adoc[XML Tokenize]
language is recommended as it offers a faster, more efficient
tokenization specifically for XML documents.
+
== Tokenize Options
// language options: START
@@ -45,9 +46,11 @@ The Tokenize language supports 11 options, which are listed below.
// language options: END
-== Example usage
+== Example
-The following example shows how to take a request from the *direct:a* endpoint the split it into pieces using an Expression, then forward each piece to *direct:b*
+The following example shows how to take a request from the direct:a endpoint
+then split it into pieces using an xref:manual::expression.adoc[Expression],
+then forward each piece to direct:b:
[source,xml]
----