You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by ac...@apache.org on 2021/02/18 13:26:17 UTC
[camel-kafka-connector] branch remove-headers-docs created (now
6c3d2e8)
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a change to branch remove-headers-docs
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git.
at 6c3d2e8 Added remove headers doc page to nav
This branch includes the following new commits:
new 969214a Added remove headers documentation
new 0f673e1 Added remove headers page to index.adoc
new 6c3d2e8 Added remove headers doc page to nav
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[camel-kafka-connector] 03/03: Added remove headers doc page to nav
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch remove-headers-docs
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 6c3d2e85a80d7fe3375cb5413938b84529694b71
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Feb 18 14:25:52 2021 +0100
Added remove headers doc page to nav
---
docs/modules/ROOT/nav.adoc | 1 +
1 file changed, 1 insertion(+)
diff --git a/docs/modules/ROOT/nav.adoc b/docs/modules/ROOT/nav.adoc
index ba70c20..f96c859 100644
--- a/docs/modules/ROOT/nav.adoc
+++ b/docs/modules/ROOT/nav.adoc
@@ -3,6 +3,7 @@
** xref:basic-configuration.adoc[Basic configuration]
** xref:aggregation.adoc[Aggregation]
** xref:idempotency.adoc[Idempotency]
+** xref:remove-headers.adoc[Remove Headers]
* xref:archetypes.adoc[Archetypes]
** xref:archetype-connector.adoc[Extensible connector archetype]
** xref:archetype-dataformat-connector.adoc[Extensible Dataformat connector archetype]
[camel-kafka-connector] 02/03: Added remove headers page to
index.adoc
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch remove-headers-docs
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 0f673e1a046566dea7cc5a0705c037e468acd1f2
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Feb 18 14:25:13 2021 +0100
Added remove headers page to index.adoc
---
docs/modules/ROOT/pages/index.adoc | 1 +
1 file changed, 1 insertion(+)
diff --git a/docs/modules/ROOT/pages/index.adoc b/docs/modules/ROOT/pages/index.adoc
index 484fd42..0185cf8 100644
--- a/docs/modules/ROOT/pages/index.adoc
+++ b/docs/modules/ROOT/pages/index.adoc
@@ -6,6 +6,7 @@
** xref:basic-configuration.adoc[Basic configuration]
** xref:aggregation.adoc[Aggregation]
** xref:idempotency.adoc[Idempotency]
+** xref:remove-headers.adoc[Remove Headers]
* xref:archetypes.adoc[Archetypes]
** xref:archetype-connector.adoc[Extensible connector archetype]
** xref:archetype-dataformat-connector.adoc[Extensible Dataformat connector archetype]
[camel-kafka-connector] 01/03: Added remove headers documentation
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch remove-headers-docs
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 969214a7751f9130cfb674947af969b789533efd
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Feb 18 14:24:30 2021 +0100
Added remove headers documentation
---
docs/modules/ROOT/pages/remove-headers.adoc | 30 +++++++++++++++++++++++++++++
1 file changed, 30 insertions(+)
diff --git a/docs/modules/ROOT/pages/remove-headers.adoc b/docs/modules/ROOT/pages/remove-headers.adoc
new file mode 100644
index 0000000..207477c
--- /dev/null
+++ b/docs/modules/ROOT/pages/remove-headers.adoc
@@ -0,0 +1,30 @@
+[[RemovedHeaders-RemovedHeaders]]
+= Remove Headers
+
+As you know in Camel Kafka Connector there is a mixing between Camel and Kafka headers. There are scenario where a typical user would like to remove some of the Camel Headers, because otherwise he would
+trigger a particular behavior while moving record between a source connector and sink connector.
+
+Starting from Camel Kafka connector 0.7.0, we introduced the removeHeaders option "camel.remove.headers.pattern=CamelAwsS3BucketName"
+
+This option is valid for both source and sink connector and support any regex.
+
+For example in Camel AWS2 S3 connector there is a particular header, set while consuming file from a bucket ("CamelAwsS3BucketName"), if this header will be passed to a sink connector the bucket name set in
+the sink connector configuration will be override. For this particular case a user can specify:
+
+[source,bash]
+----
+name=CamelAWS2S3SinkConnector
+connector.class=org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector
+key.converter=org.apache.kafka.connect.storage.StringConverter
+value.converter=org.apache.kafka.connect.storage.StringConverter
+
+topics=mytopic
+
+camel.sink.path.bucketNameOrArn=camel-kafka-connector-1
+camel.remove.headers.pattern=CamelAwsS3BucketName
+camel.component.aws2-s3.accessKey=<access_key>
+camel.component.aws2-s3.secretKey=<secret_key>
+camel.component.aws2-s3.region=<region>
+----
+
+In this way the header will be removed and the normal flow will go ahead.