You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by ac...@apache.org on 2020/11/12 15:21:34 UTC
[camel-kafka-connector] branch master updated (480eec2 -> 540b5a6)
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git.
from 480eec2 Added missing dependency causing Strimzi tests to fail
new fc9a9b3 Add RemoteFileTransforms to the FTPS connector directly
new 540b5a6 Regen catalog
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../src/generated/resources/connectors/camel-ftps-sink.json | 5 ++++-
.../src/generated/resources/connectors/camel-ftps-source.json | 5 ++++-
.../src/generated/resources/camel-ftps-sink.json | 5 ++++-
.../src/generated/resources/camel-ftps-source.json | 5 ++++-
.../src/main/docs/camel-ftps-kafka-sink-connector.adoc | 9 ++++++++-
.../src/main/docs/camel-ftps-kafka-source-connector.adoc | 9 ++++++++-
.../ftps/transformers/FtpsRemoteFileTransforms.java} | 6 +++---
.../ROOT/pages/connectors/camel-ftps-kafka-sink-connector.adoc | 9 ++++++++-
.../ROOT/pages/connectors/camel-ftps-kafka-source-connector.adoc | 9 ++++++++-
9 files changed, 51 insertions(+), 11 deletions(-)
copy connectors/{camel-sftp-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/sftp/transformers/SftpRemoteFileTransforms.java => camel-ftps-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/ftps/transformers/FtpsRemoteFileTransforms.java} (91%)
[camel-kafka-connector] 01/02: Add RemoteFileTransforms to the FTPS
connector directly
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit fc9a9b3c1ea034c29d2bce1774983876ab187eeb
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Nov 12 14:56:49 2020 +0100
Add RemoteFileTransforms to the FTPS connector directly
---
.../transformers/FtpsRemoteFileTransforms.java | 71 ++++++++++++++++++++++
1 file changed, 71 insertions(+)
diff --git a/connectors/camel-ftps-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/ftps/transformers/FtpsRemoteFileTransforms.java b/connectors/camel-ftps-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/ftps/transformers/FtpsRemoteFileTransforms.java
new file mode 100644
index 0000000..7d9d13c
--- /dev/null
+++ b/connectors/camel-ftps-kafka-connector/src/main/java/org/apache/camel/kafkaconnector/ftps/transformers/FtpsRemoteFileTransforms.java
@@ -0,0 +1,71 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.camel.kafkaconnector.ftps.transformers;
+
+import java.util.Map;
+
+import org.apache.camel.component.file.remote.RemoteFile;
+import org.apache.camel.kafkaconnector.utils.SchemaHelper;
+import org.apache.kafka.common.config.ConfigDef;
+import org.apache.kafka.connect.connector.ConnectRecord;
+import org.apache.kafka.connect.transforms.Transformation;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+public class FtpsRemoteFileTransforms <R extends ConnectRecord<R>> implements Transformation<R> {
+ public static final String FIELD_KEY_CONFIG = "key";
+ public static final ConfigDef CONFIG_DEF = new ConfigDef()
+ .define(FIELD_KEY_CONFIG, ConfigDef.Type.STRING, null, ConfigDef.Importance.MEDIUM,
+ "Transforms Remote File to String");
+
+ private static final Logger LOG = LoggerFactory.getLogger(FtpsRemoteFileTransforms.class);
+
+ @Override
+ public R apply(R r) {
+ Object value = r.value();
+
+ if (r.value() instanceof RemoteFile) {
+ LOG.debug("Converting record from RemoteFile to text");
+ RemoteFile message = (RemoteFile) r.value();
+
+ LOG.debug("Received text: {}", message.getBody());
+
+ return r.newRecord(r.topic(), r.kafkaPartition(), null, r.key(),
+ SchemaHelper.buildSchemaBuilderForType(message.getBody()), message.getBody(), r.timestamp());
+
+ } else {
+ LOG.debug("Unexpected message type: {}", r.value().getClass());
+
+ return r;
+ }
+ }
+
+ @Override
+ public ConfigDef config() {
+ return CONFIG_DEF;
+ }
+
+ @Override
+ public void close() {
+
+ }
+
+ @Override
+ public void configure(Map<String, ?> map) {
+
+ }
+}
[camel-kafka-connector] 02/02: Regen catalog
Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
acosentino pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit 540b5a6ab22bd4723e4adc5e7758ecf0b6159415
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Thu Nov 12 15:10:28 2020 +0100
Regen catalog
---
.../src/generated/resources/connectors/camel-ftps-sink.json | 5 ++++-
.../src/generated/resources/connectors/camel-ftps-source.json | 5 ++++-
.../src/generated/resources/camel-ftps-sink.json | 5 ++++-
.../src/generated/resources/camel-ftps-source.json | 5 ++++-
.../src/main/docs/camel-ftps-kafka-sink-connector.adoc | 9 ++++++++-
.../src/main/docs/camel-ftps-kafka-source-connector.adoc | 9 ++++++++-
.../ROOT/pages/connectors/camel-ftps-kafka-sink-connector.adoc | 9 ++++++++-
.../ROOT/pages/connectors/camel-ftps-kafka-source-connector.adoc | 9 ++++++++-
8 files changed, 48 insertions(+), 8 deletions(-)
diff --git a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-sink.json b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-sink.json
index 1e05d4e..ee1d57e 100644
--- a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-sink.json
+++ b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-sink.json
@@ -395,5 +395,8 @@
"priority": "MEDIUM",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-source.json b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-source.json
index a56bc28..3734e61 100644
--- a/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-source.json
+++ b/camel-kafka-connector-catalog/src/generated/resources/connectors/camel-ftps-source.json
@@ -728,5 +728,8 @@
"priority": "MEDIUM",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-sink.json b/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-sink.json
index b937946..74eba56 100644
--- a/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-sink.json
+++ b/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-sink.json
@@ -395,5 +395,8 @@
"priority": "MEDIUM",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-source.json b/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-source.json
index 3091da6..60cca1a 100644
--- a/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-source.json
+++ b/connectors/camel-ftps-kafka-connector/src/generated/resources/camel-ftps-source.json
@@ -728,5 +728,8 @@
"priority": "MEDIUM",
"required": "false"
}
- }
+ },
+ "transforms": [
+ "org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms"
+ ]
}
\ No newline at end of file
diff --git a/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-sink-connector.adoc b/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-sink-connector.adoc
index ae5e334..1e3bb25 100644
--- a/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-sink-connector.adoc
+++ b/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-sink-connector.adoc
@@ -98,10 +98,17 @@ The camel-ftps sink connector has no converters out of the box.
-The camel-ftps sink connector has no transforms out of the box.
+The camel-ftps sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms
+
+----
+
The camel-ftps sink connector has no aggregation strategies out of the box.
diff --git a/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-source-connector.adoc b/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-source-connector.adoc
index 516c46b..7cd03ba 100644
--- a/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-source-connector.adoc
+++ b/connectors/camel-ftps-kafka-connector/src/main/docs/camel-ftps-kafka-source-connector.adoc
@@ -149,10 +149,17 @@ The camel-ftps sink connector has no converters out of the box.
-The camel-ftps sink connector has no transforms out of the box.
+The camel-ftps sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms
+
+----
+
The camel-ftps sink connector has no aggregation strategies out of the box.
diff --git a/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-sink-connector.adoc b/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-sink-connector.adoc
index ae5e334..1e3bb25 100644
--- a/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-sink-connector.adoc
+++ b/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-sink-connector.adoc
@@ -98,10 +98,17 @@ The camel-ftps sink connector has no converters out of the box.
-The camel-ftps sink connector has no transforms out of the box.
+The camel-ftps sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms
+
+----
+
The camel-ftps sink connector has no aggregation strategies out of the box.
diff --git a/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-source-connector.adoc b/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-source-connector.adoc
index 516c46b..7cd03ba 100644
--- a/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-source-connector.adoc
+++ b/docs/modules/ROOT/pages/connectors/camel-ftps-kafka-source-connector.adoc
@@ -149,10 +149,17 @@ The camel-ftps sink connector has no converters out of the box.
-The camel-ftps sink connector has no transforms out of the box.
+The camel-ftps sink connector supports 0 transforms out of the box, which are listed below.
+[source,java]
+----
+
+org.apache.camel.kafkaconnector.ftps.transformers.FtpsRemoteFileTransforms
+
+----
+
The camel-ftps sink connector has no aggregation strategies out of the box.