You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by ac...@apache.org on 2020/11/09 10:22:51 UTC
[camel-kafka-connector] branch master updated (556e41a -> 624c145)
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git.
from 556e41a Added Download page
new 09c4453 SFTP connector: Add RemoteFileTransforms to the connector directly
new b20fa96 Regen catalog
new 624c145 Added license to SftpRemoteFileTransforms
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../resources/connectors/camel-sftp-sink.json | 5 ++++-
.../resources/connectors/camel-sftp-source.json | 5 ++++-
.../src/generated/resources/camel-sftp-sink.json | 5 ++++-
.../src/generated/resources/camel-sftp-source.json | 5 ++++-
.../main/docs/camel-sftp-kafka-sink-connector.adoc | 9 ++++++++-
.../docs/camel-sftp-kafka-source-connector.adoc | 9 ++++++++-
.../transformers/SftpRemoteFileTransforms.java} | 21 ++++++++++-----------
docs/modules/ROOT/pages/connectors.adoc | 2 +-
.../connectors/camel-sftp-kafka-sink-connector.adoc | 9 ++++++++-
.../camel-sftp-kafka-source-connector.adoc | 9 ++++++++-
10 files changed, 59 insertions(+), 20 deletions(-)
copy connectors/{camel-slack-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/slack/transformers/SlackTransforms.java => camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java} (73%)
[camel-kafka-connector] 01/03: SFTP connector: Add
RemoteFileTransforms to the connector directly
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 09c44536310723b4edcb53b479b0ab6b2014fac8
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Mon Nov 9 08:25:27 2020 +0100
SFTP connector: Add RemoteFileTransforms to the connector directly
---
.../transformers/SftpRemoteFileTransforms.java | 55 ++++++++++++++++++++++
1 file changed, 55 insertions(+)
diff --git a/connectors/camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java b/connectors/camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java
new file mode 100644
index 0000000..d04cf99
--- /dev/null
+++ b/connectors/camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java
@@ -0,0 +1,55 @@
+package org.apache.camel.kafkaconnector.sftp.transformers;
+
+import java.util.Map;
+
+import org.apache.camel.component.file.remote.RemoteFile;
+import org.apache.camel.kafkaconnector.utils.SchemaHelper;
+import org.apache.kafka.common.config.ConfigDef;
+import org.apache.kafka.connect.connector.ConnectRecord;
+import org.apache.kafka.connect.transforms.Transformation;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+public class SftpRemoteFileTransforms <R extends ConnectRecord<R>> implements Transformation<R> {
+ public static final String FIELD_KEY_CONFIG = "key";
+ public static final ConfigDef CONFIG_DEF = new ConfigDef()
+ .define(FIELD_KEY_CONFIG, ConfigDef.Type.STRING, null, ConfigDef.Importance.MEDIUM,
+ "Transforms Remote File to String");
+
+ private static final Logger LOG = LoggerFactory.getLogger(SftpRemoteFileTransforms.class);
+
+ @Override
+ public R apply(R r) {
+ Object value = r.value();
+
+ if (r.value() instanceof RemoteFile) {
+ LOG.debug("Converting record from RemoteFile to text");
+ RemoteFile message = (RemoteFile) r.value();
+
+ LOG.debug("Received text: {}", message.getBody());
+
+ return r.newRecord(r.topic(), r.kafkaPartition(), null, r.key(),
+ SchemaHelper.buildSchemaBuilderForType(message.getBody()), message.getBody(), r.timestamp());
+
+ } else {
+ LOG.debug("Unexpected message type: {}", r.value().getClass());
+
+ return r;
+ }
+ }
+
+ @Override
+ public ConfigDef config() {
+ return CONFIG_DEF;
+ }
+
+ @Override
+ public void close() {
+
+ }
+
+ @Override
+ public void configure(Map<String, ?> map) {
+
+ }
+}
[camel-kafka-connector] 03/03: Added license to
SftpRemoteFileTransforms
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 624c145f2f45c0df8f34a684e75b3dcf2874ef2c
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Mon Nov 9 08:56:45 2020 +0100
Added license to SftpRemoteFileTransforms
---
.../sftp/transformers/SftpRemoteFileTransforms.java | 16 ++++++++++++++++
1 file changed, 16 insertions(+)
diff --git a/connectors/camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java b/connectors/camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java
index d04cf99..4d3c98e 100644
--- a/connectors/camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java
+++ b/connectors/camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java
@@ -1,3 +1,19 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
package org.apache.camel.kafkaconnector.sftp.transformers;
import java.util.Map;
[camel-kafka-connector] 02/03: Regen catalog
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit b20fa964bc45e4c37236dd88ddfd2a81d92474bc
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Mon Nov 9 08:44:09 2020 +0100
Regen catalog
---
.../src/generated/resources/connectors/camel-sftp-sink.json | 5 ++++-
.../src/generated/resources/connectors/camel-sftp-source.json | 5 ++++-
.../src/generated/resources/camel-sftp-sink.json | 5 ++++-
.../src/generated/resources/camel-sftp-source.json | 5 ++++-
.../src/main/docs/camel-sftp-kafka-sink-connector.adoc | 9 ++++++++-
.../src/main/docs/camel-sftp-kafka-source-connector.adoc | 9 ++++++++-
docs/modules/ROOT/pages/connectors.adoc | 2 +-
.../ROOT/pages/connectors/camel-sftp-kafka-sink-connector.adoc | 9 ++++++++-
.../ROOT/pages/connectors/camel-sftp-kafka-source-connector.adoc | 9 ++++++++-
9 files changed, 49 insertions(+), 9 deletions(-)
diff --git a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-sink.json b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-sink.json
index 673ddf2..3367a98 100644
--- a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-sink.json
+++ b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-sink.json
@@ -392,5 +392,8 @@
"priority": "LOW",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-source.json b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-source.json
index e6b5b29..d659c28 100644
--- a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-source.json
+++ b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-sftp-source.json
@@ -736,5 +736,8 @@
"priority": "LOW",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-sink.json b/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-sink.json
index 4ee990d..f1554e7 100644
--- a/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-sink.json
+++ b/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-sink.json
@@ -392,5 +392,8 @@
"priority": "LOW",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-source.json b/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-source.json
index 6453c8b..5646334 100644
--- a/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-source.json
+++ b/connectors/camel-sftp-kafka-connector/src/generated/resources/camel-sftp-source.json
@@ -736,5 +736,8 @@
"priority": "LOW",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-sink-connector.adoc b/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-sink-connector.adoc
index ca9f404..8c20a32 100644
--- a/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-sink-connector.adoc
+++ b/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-sink-connector.adoc
@@ -98,10 +98,17 @@ The camel-sftp sink connector has no converters out of the box.
-The camel-sftp sink connector has no transforms out of the box.
+The camel-sftp sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms
+
+----
+
The camel-sftp sink connector has no aggregation strategies out of the box.
diff --git a/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-source-connector.adoc b/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-source-connector.adoc
index 3ed7f49..3c4d159 100644
--- a/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-source-connector.adoc
+++ b/connectors/camel-sftp-kafka-connector/src/main/docs/camel-sftp-kafka-source-connector.adoc
@@ -151,10 +151,17 @@ The camel-sftp sink connector has no converters out of the box.
-The camel-sftp sink connector has no transforms out of the box.
+The camel-sftp sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms
+
+----
+
The camel-sftp sink connector has no aggregation strategies out of the box.
diff --git a/docs/modules/ROOT/pages/connectors.adoc b/docs/modules/ROOT/pages/connectors.adoc
index 997777a..7a88ca6 100644
--- a/docs/modules/ROOT/pages/connectors.adoc
+++ b/docs/modules/ROOT/pages/connectors.adoc
@@ -2,7 +2,7 @@
= Supported connectors and documentation
// kafka-connectors list: START
-Number of Camel Kafka connectors: 347
+Number of Camel Kafka connectors: 346
[width="100%",cols="4,1,1,1,1,1,1",options="header"]
|===
diff --git a/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-sink-connector.adoc b/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-sink-connector.adoc
index ca9f404..8c20a32 100644
--- a/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-sink-connector.adoc
+++ b/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-sink-connector.adoc
@@ -98,10 +98,17 @@ The camel-sftp sink connector has no converters out of the box.
-The camel-sftp sink connector has no transforms out of the box.
+The camel-sftp sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms
+
+----
+
The camel-sftp sink connector has no aggregation strategies out of the box.
diff --git a/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-source-connector.adoc b/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-source-connector.adoc
index 3ed7f49..3c4d159 100644
--- a/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-source-connector.adoc
+++ b/docs/modules/ROOT/pages/connectors/camel-sftp-kafka-source-connector.adoc
@@ -151,10 +151,17 @@ The camel-sftp sink connector has no converters out of the box.
-The camel-sftp sink connector has no transforms out of the box.
+The camel-sftp sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.sftp.transformers.SftpRemoteFileTransforms
+
+----
+
The camel-sftp sink connector has no aggregation strategies out of the box.