You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by ac...@apache.org on 2021/02/18 15:43:51 UTC
[camel-kafka-connector] branch camel-master updated (eb81f69 ->
7b6a380)
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a change to branch camel-master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git.
from eb81f69 Avoid using static hostnames in tests
new f1d057e Added remove headers documentation
new 009134d Added remove headers page to index.adoc
new 7b6a380 Added remove headers doc page to nav
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/modules/ROOT/nav.adoc | 1 +
docs/modules/ROOT/pages/index.adoc | 1 +
docs/modules/ROOT/pages/remove-headers.adoc | 30 +++++++++++++++++++++++++++++
3 files changed, 32 insertions(+)
create mode 100644 docs/modules/ROOT/pages/remove-headers.adoc
[camel-kafka-connector] 03/03: Added remove headers doc page to nav
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch camel-master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 7b6a380b9a3e7799ab830ebebc9a363c9376e033
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Feb 18 14:25:52 2021 +0100
Added remove headers doc page to nav
---
docs/modules/ROOT/nav.adoc | 1 +
1 file changed, 1 insertion(+)
diff --git a/docs/modules/ROOT/nav.adoc b/docs/modules/ROOT/nav.adoc
index ba70c20..f96c859 100644
--- a/docs/modules/ROOT/nav.adoc
+++ b/docs/modules/ROOT/nav.adoc
@@ -3,6 +3,7 @@
** xref:basic-configuration.adoc[Basic configuration]
** xref:aggregation.adoc[Aggregation]
** xref:idempotency.adoc[Idempotency]
+** xref:remove-headers.adoc[Remove Headers]
* xref:archetypes.adoc[Archetypes]
** xref:archetype-connector.adoc[Extensible connector archetype]
** xref:archetype-dataformat-connector.adoc[Extensible Dataformat connector archetype]
[camel-kafka-connector] 02/03: Added remove headers page to
index.adoc
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch camel-master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 009134d5d187072b4bb33a027cf98b6125c9fa7e
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Feb 18 14:25:13 2021 +0100
Added remove headers page to index.adoc
---
docs/modules/ROOT/pages/index.adoc | 1 +
1 file changed, 1 insertion(+)
diff --git a/docs/modules/ROOT/pages/index.adoc b/docs/modules/ROOT/pages/index.adoc
index 484fd42..0185cf8 100644
--- a/docs/modules/ROOT/pages/index.adoc
+++ b/docs/modules/ROOT/pages/index.adoc
@@ -6,6 +6,7 @@
** xref:basic-configuration.adoc[Basic configuration]
** xref:aggregation.adoc[Aggregation]
** xref:idempotency.adoc[Idempotency]
+** xref:remove-headers.adoc[Remove Headers]
* xref:archetypes.adoc[Archetypes]
** xref:archetype-connector.adoc[Extensible connector archetype]
** xref:archetype-dataformat-connector.adoc[Extensible Dataformat connector archetype]
[camel-kafka-connector] 01/03: Added remove headers documentation
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch camel-master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit f1d057e9a647c11e6dc64cec68715945ea6516f2
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Feb 18 14:24:30 2021 +0100
Added remove headers documentation
---
docs/modules/ROOT/pages/remove-headers.adoc | 30 +++++++++++++++++++++++++++++
1 file changed, 30 insertions(+)
diff --git a/docs/modules/ROOT/pages/remove-headers.adoc b/docs/modules/ROOT/pages/remove-headers.adoc
new file mode 100644
index 0000000..207477c
--- /dev/null
+++ b/docs/modules/ROOT/pages/remove-headers.adoc
@@ -0,0 +1,30 @@
+[[RemovedHeaders-RemovedHeaders]]
+= Remove Headers
+
+As you know in Camel Kafka Connector there is a mixing between Camel and Kafka headers. There are scenario where a typical user would like to remove some of the Camel Headers, because otherwise he would
+trigger a particular behavior while moving record between a source connector and sink connector.
+
+Starting from Camel Kafka connector 0.7.0, we introduced the removeHeaders option "camel.remove.headers.pattern=CamelAwsS3BucketName"
+
+This option is valid for both source and sink connector and support any regex.
+
+For example in Camel AWS2 S3 connector there is a particular header, set while consuming file from a bucket ("CamelAwsS3BucketName"), if this header will be passed to a sink connector the bucket name set in
+the sink connector configuration will be override. For this particular case a user can specify:
+
+[source,bash]
+----
+name=CamelAWS2S3SinkConnector
+connector.class=org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector
+key.converter=org.apache.kafka.connect.storage.StringConverter
+value.converter=org.apache.kafka.connect.storage.StringConverter
+
+topics=mytopic
+
+camel.sink.path.bucketNameOrArn=camel-kafka-connector-1
+camel.remove.headers.pattern=CamelAwsS3BucketName
+camel.component.aws2-s3.accessKey=<access_key>
+camel.component.aws2-s3.secretKey=<secret_key>
+camel.component.aws2-s3.region=<region>
+----
+
+In this way the header will be removed and the normal flow will go ahead.