You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by nf...@apache.org on 2021/03/24 18:48:17 UTC
[camel-kamelets] branch master updated (0851143 -> 60ece4d)
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git.
from 0851143 Added Dropbox Sink Kamelet
new aaf41bf Added AWS DDB Streams Source Kamelet
new e463e5e Added AWS DDB Streams Source Kamelet
new b970b9a Added AWS DDB Streams Source Kamelet
new 2a36c9f Added AWS DDB Streams Source Kamelet
new 6358d8d Added AWS DDB Streams Source Kamelet
new 22367e4 Added AWS DDB Streams Source Kamelet
new 265133d Added AWS DDB Streams Source Kamelet
new f08b8b2 Added AWS DDB Streams Source Kamelet
new 7ac0a4d Added AWS DDB Streams Source Kamelet
new 60ece4d Added AWS DDB Streams Source Kamelet
The 10 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
aws-ddb-streams-source.kamelet.yaml | 71 ++++++++++++++++++++++
.../images/kamelets/aws-ddb-streams-source.svg | 1 +
docs/modules/ROOT/nav.adoc | 1 +
.../modules/ROOT/pages/aws-ddb-streams-source.adoc | 67 ++++++++++++++++++++
4 files changed, 140 insertions(+)
create mode 100644 aws-ddb-streams-source.kamelet.yaml
create mode 100644 docs/modules/ROOT/assets/images/kamelets/aws-ddb-streams-source.svg
create mode 100644 docs/modules/ROOT/pages/aws-ddb-streams-source.adoc
[camel-kamelets] 07/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit 265133d1d9dfa2d50ad5f656a29685640e6e6d9f
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 16:59:33 2021 +0100
Added AWS DDB Streams Source Kamelet
---
aws-ddb-streams-source.kamelet.yaml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/aws-ddb-streams-source.kamelet.yaml b/aws-ddb-streams-source.kamelet.yaml
index 389ade2..032b9cd 100644
--- a/aws-ddb-streams-source.kamelet.yaml
+++ b/aws-ddb-streams-source.kamelet.yaml
@@ -18,7 +18,7 @@ spec:
- secretKey
- region
properties:
- bucketNameOrArn:
+ table:
title: Table
description: Name of the DynamoDB table to look at
type: string
[camel-kamelets] 03/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit b970b9abe053a541bc9283fa5d9d26eef7a9d6e0
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 14:45:44 2021 +0100
Added AWS DDB Streams Source Kamelet
---
.../images/kamelets/aws-ddb-streams-source.svg | 1 +
.../modules/ROOT/pages/aws-ddb-streams-source.adoc | 67 ++++++++++++++++++++++
2 files changed, 68 insertions(+)
diff --git a/docs/modules/ROOT/assets/images/kamelets/aws-ddb-streams-source.svg b/docs/modules/ROOT/assets/images/kamelets/aws-ddb-streams-source.svg
new file mode 100644
index 0000000..c0f23d9
--- /dev/null
+++ b/docs/modules/ROOT/assets/images/kamelets/aws-ddb-streams-source.svg
@@ -0,0 +1 @@
+<svg height="100" width="100" xmlns="http://www.w3.org/2000/svg"><path fill="#2D72B8" d="M74.174 31.807l7.437 5.367v-7.602l-7.48-8.765v10.957l.043.015z"/><path fill="#5294CF" d="M59.838 85.666l14.293-7.146V20.791l-14.303-7.124z"/><path fill="#205B98" d="M39.496 85.666L25.203 78.52V20.791l14.303-7.124z"/><path fill="#2D72B8" d="M39.506 13.667h20.321v71.999H39.506zM74.131 67.564V78.52l7.48-8.764v-7.602l-7.437 5.397zM74.131 62.936l.043-.01 7.437-4v-7.649l-7.48.688zM74.174 36.429l-.043-.01V4 [...]
\ No newline at end of file
diff --git a/docs/modules/ROOT/pages/aws-ddb-streams-source.adoc b/docs/modules/ROOT/pages/aws-ddb-streams-source.adoc
new file mode 100644
index 0000000..0bc95f2
--- /dev/null
+++ b/docs/modules/ROOT/pages/aws-ddb-streams-source.adoc
@@ -0,0 +1,67 @@
+// THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT
+= image:kamelets/aws-ddb-streams-source.svg[] AWS DDB Streams Source
+
+*Provided by: "Apache Software Foundation"*
+
+Receive events from AWS DDB Streams.
+
+== Configuration Options
+
+The following table summarizes the configuration options available for the `aws-ddb-streams-source` Kamelet:
+[width="100%",cols="2,^2,3,^2,^2,^3",options="header"]
+|===
+| Property| Name| Description| Type| Default| Example
+| *accessKey {empty}* *| Access Key| The access key obtained from AWS| string| |
+| *region {empty}* *| AWS Region| The AWS region to connect to| string| | `"eu-west-1"`
+| *secretKey {empty}* *| Secret Key| The secret key obtained from AWS| string| |
+| bucketNameOrArn| Table| Name of the DynamoDB table to look at| string| |
+| iteratorType| Iterator Type| Defines where in the DynaboDB stream to start getting records. Note that using TRIM_HORIZON can cause a significant delay before the stream has caught up to real-time. if {AT,AFTER}_SEQUENCE_NUMBER are used, then a sequenceNumberProvider MUST be supplied. There are 4 enums and the value can be one of TRIM_HORIZON, LATEST, AT_SEQUENCE_NUMBER, AFTER_SEQUENCE_NUMBER| String| `"LATEST"`|
+| sequenceNumberProvider| Sequence Number Provider| Provider for the sequence number when using one of the two ShardIteratorType AT_SEQUENCE_NUMBER or AFTER_SEQUENCE_NUMBER iterator types. Can be a registry reference or a literal sequence number.| string| | `"900000000005745712447"`
+|===
+
+NOTE: Fields marked with ({empty}*) are mandatory.
+
+== Usage
+
+This section summarizes how the `aws-ddb-streams-source` can be used in various contexts.
+
+=== Knative Source
+
+The `aws-ddb-streams-source` Kamelet can be used as Knative source by binding it to a Knative object.
+
+.aws-ddb-streams-source-binding.yaml
+[source,yaml]
+----
+apiVersion: camel.apache.org/v1alpha1
+kind: KameletBinding
+metadata:
+ name: aws-ddb-streams-source-binding
+spec:
+ source:
+ ref:
+ kind: Kamelet
+ apiVersion: camel.apache.org/v1alpha1
+ name: aws-ddb-streams-source
+ properties:
+ accessKey: "The Access Key"
+ region: "eu-west-1"
+ secretKey: "The Secret Key"
+ sink:
+ ref:
+ kind: InMemoryChannel
+ apiVersion: messaging.knative.dev/v1
+ name: mychannel
+
+----
+
+Make sure you have xref:latest@camel-k::installation/installation.adoc[Camel K installed] into the Kubernetes cluster you're connected to.
+
+Save the `aws-ddb-streams-source-binding.yaml` file into your hard drive, then configure it according to your needs.
+
+You can run the source using the following command:
+
+[source,shell]
+----
+kubectl apply -f aws-ddb-streams-source-binding.yaml
+----
+// THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT
[camel-kamelets] 02/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit e463e5e0e02de61c159e956a1718202a325b4a30
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 14:45:29 2021 +0100
Added AWS DDB Streams Source Kamelet
---
docs/modules/ROOT/nav.adoc | 1 +
1 file changed, 1 insertion(+)
diff --git a/docs/modules/ROOT/nav.adoc b/docs/modules/ROOT/nav.adoc
index 9e4e74f..278f4fb 100644
--- a/docs/modules/ROOT/nav.adoc
+++ b/docs/modules/ROOT/nav.adoc
@@ -1,4 +1,5 @@
// THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT
+* xref:ROOT:aws-ddb-streams-source.adoc[image:kamelets/aws-ddb-streams-source.svg[] AWS DDB Streams Source]
* xref:ROOT:aws-kinesis-source.adoc[image:kamelets/aws-kinesis-source.svg[] AWS Kinesis Source]
* xref:ROOT:aws-s3-source.adoc[image:kamelets/aws-s3-source.svg[] AWS S3 Source]
* xref:ROOT:aws-sqs-fifo-sink.adoc[image:kamelets/aws-sqs-fifo-sink.svg[] AWS SQS FIFO Sink]
[camel-kamelets] 01/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit aaf41bf97dd9433228d21a22f9e17f72827b0aed
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 14:44:58 2021 +0100
Added AWS DDB Streams Source Kamelet
---
aws-ddb-streams-source.kamelet.yaml | 67 +++++++++++++++++++++++++++++++++++++
1 file changed, 67 insertions(+)
diff --git a/aws-ddb-streams-source.kamelet.yaml b/aws-ddb-streams-source.kamelet.yaml
new file mode 100644
index 0000000..2d7c7a1
--- /dev/null
+++ b/aws-ddb-streams-source.kamelet.yaml
@@ -0,0 +1,67 @@
+apiVersion: camel.apache.org/v1alpha1
+kind: Kamelet
+metadata:
+ name: aws-ddb-streams-source
+ annotations:
+ camel.apache.org/kamelet.icon: "data:image/svg+xml;base64,PHN2ZyBoZWlnaHQ9IjEwMCIgd2lkdGg9IjEwMCIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj48cGF0aCBmaWxsPSIjMkQ3MkI4IiBkPSJNNzQuMTc0IDMxLjgwN2w3LjQzNyA1LjM2N3YtNy42MDJsLTcuNDgtOC43NjV2MTAuOTU3bC4wNDMuMDE1eiIvPjxwYXRoIGZpbGw9IiM1Mjk0Q0YiIGQ9Ik01OS44MzggODUuNjY2bDE0LjI5My03LjE0NlYyMC43OTFsLTE0LjMwMy03LjEyNHoiLz48cGF0aCBmaWxsPSIjMjA1Qjk4IiBkPSJNMzkuNDk2IDg1LjY2NkwyNS4yMDMgNzguNTJWMjAuNzkxbDE0LjMwMy03LjEyNHoiLz48cGF0aCBmaWxsPSIjMkQ3Mk [...]
+ camel.apache.org/provider: "Apache Software Foundation"
+ labels:
+ camel.apache.org/kamelet.type: "source"
+spec:
+ definition:
+ title: "AWS DDB Streams Source"
+ description: |-
+ Receive events from AWS DDB Streams.
+ required:
+ - table
+ - accessKey
+ - secretKey
+ - region
+ properties:
+ bucketNameOrArn:
+ title: Table
+ description: Name of the DynamoDB table to look at
+ type: string
+ accessKey:
+ title: Access Key
+ description: The access key obtained from AWS
+ type: string
+ x-descriptors:
+ - urn:alm:descriptor:com.tectonic.ui:password
+ secretKey:
+ title: Secret Key
+ description: The secret key obtained from AWS
+ type: string
+ x-descriptors:
+ - urn:alm:descriptor:com.tectonic.ui:password
+ region:
+ title: AWS Region
+ description: The AWS region to connect to
+ type: string
+ example: eu-west-1
+ iteratorType:
+ title: Iterator Type
+ description: Defines where in the DynaboDB stream to start getting records. Note that using TRIM_HORIZON can cause a significant delay before the stream has caught up to real-time. if {AT,AFTER}_SEQUENCE_NUMBER are used, then a sequenceNumberProvider MUST be supplied. There are 4 enums and the value can be one of TRIM_HORIZON, LATEST, AT_SEQUENCE_NUMBER, AFTER_SEQUENCE_NUMBER
+ type: String
+ x-descriptors:
+ - 'urn:alm:descriptor:com.tectonic.ui:checkbox'
+ default: LATEST
+ sequenceNumberProvider:
+ title: Sequence Number Provider
+ description: Provider for the sequence number when using one of the two ShardIteratorType AT_SEQUENCE_NUMBER or AFTER_SEQUENCE_NUMBER iterator types. Can be a registry reference or a literal sequence number.
+ type: string
+ example: "900000000005745712447"
+ types:
+ out:
+ mediaType: application/json
+ flow:
+ from:
+ uri: "aws2-ddbstream:{{tableName}}"
+ parameters:
+ secretKey: "{{secretKey}}"
+ accessKey: "{{accessKey}}"
+ region: "{{region}}"
+ iteratorType: "{{iteratorType}}"
+ sequenceNumberProvider: "{{sequenceNumberProvider}}"
+ steps:
+ - to: "kamelet:sink"
[camel-kamelets] 10/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit 60ece4db7501a32ad5584358892e52a552582e6b
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 18:36:58 2021 +0100
Added AWS DDB Streams Source Kamelet
---
aws-ddb-streams-source.kamelet.yaml | 1 +
1 file changed, 1 insertion(+)
diff --git a/aws-ddb-streams-source.kamelet.yaml b/aws-ddb-streams-source.kamelet.yaml
index 2438fa1..24a7c31 100644
--- a/aws-ddb-streams-source.kamelet.yaml
+++ b/aws-ddb-streams-source.kamelet.yaml
@@ -49,6 +49,7 @@ spec:
description: Provider for the sequence number when using one of the two ShardIteratorType AT_SEQUENCE_NUMBER or AFTER_SEQUENCE_NUMBER iterator types. Can be a registry reference or a literal sequence number.
type: string
example: "900000000005745712447"
+ default: "000000000000000000000"
types:
out:
mediaType: application/json
[camel-kamelets] 08/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit f08b8b21678147e778a57893de2a1e5d18f63f71
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 16:59:58 2021 +0100
Added AWS DDB Streams Source Kamelet
---
aws-ddb-streams-source.kamelet.yaml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/aws-ddb-streams-source.kamelet.yaml b/aws-ddb-streams-source.kamelet.yaml
index 032b9cd..e83338d 100644
--- a/aws-ddb-streams-source.kamelet.yaml
+++ b/aws-ddb-streams-source.kamelet.yaml
@@ -58,7 +58,7 @@ spec:
- "camel:gson"
flow:
from:
- uri: "aws2-ddbstream:{{tableName}}"
+ uri: "aws2-ddbstream:{{table}}"
parameters:
secretKey: "{{secretKey}}"
accessKey: "{{accessKey}}"
[camel-kamelets] 04/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit 2a36c9f605184dd81279ab9de1bf33f4ce58a7ef
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 15:09:26 2021 +0100
Added AWS DDB Streams Source Kamelet
---
aws-ddb-streams-source.kamelet.yaml | 7 +++++--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/aws-ddb-streams-source.kamelet.yaml b/aws-ddb-streams-source.kamelet.yaml
index 2d7c7a1..c5d35fa 100644
--- a/aws-ddb-streams-source.kamelet.yaml
+++ b/aws-ddb-streams-source.kamelet.yaml
@@ -9,9 +9,9 @@ metadata:
camel.apache.org/kamelet.type: "source"
spec:
definition:
- title: "AWS DDB Streams Source"
+ title: "AWS DynamoDB Streams Source"
description: |-
- Receive events from AWS DDB Streams.
+ Receive events from AWS DynamoDB Streams.
required:
- table
- accessKey
@@ -64,4 +64,7 @@ spec:
iteratorType: "{{iteratorType}}"
sequenceNumberProvider: "{{sequenceNumberProvider}}"
steps:
+ - marshal:
+ json:
+ library: Gson
- to: "kamelet:sink"
[camel-kamelets] 06/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit 22367e48cd26f8fc700b3a32adfc12c5b825478a
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 15:11:05 2021 +0100
Added AWS DDB Streams Source Kamelet
---
aws-ddb-streams-source.kamelet.yaml | 2 ++
1 file changed, 2 insertions(+)
diff --git a/aws-ddb-streams-source.kamelet.yaml b/aws-ddb-streams-source.kamelet.yaml
index c5d35fa..389ade2 100644
--- a/aws-ddb-streams-source.kamelet.yaml
+++ b/aws-ddb-streams-source.kamelet.yaml
@@ -54,6 +54,8 @@ spec:
types:
out:
mediaType: application/json
+ dependencies:
+ - "camel:gson"
flow:
from:
uri: "aws2-ddbstream:{{tableName}}"
[camel-kamelets] 09/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit 7ac0a4d7a983e7db48c230dba3ffc7698fe7f87d
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 17:50:49 2021 +0100
Added AWS DDB Streams Source Kamelet
---
aws-ddb-streams-source.kamelet.yaml | 4 +---
1 file changed, 1 insertion(+), 3 deletions(-)
diff --git a/aws-ddb-streams-source.kamelet.yaml b/aws-ddb-streams-source.kamelet.yaml
index e83338d..2438fa1 100644
--- a/aws-ddb-streams-source.kamelet.yaml
+++ b/aws-ddb-streams-source.kamelet.yaml
@@ -42,9 +42,7 @@ spec:
iteratorType:
title: Iterator Type
description: Defines where in the DynaboDB stream to start getting records. Note that using TRIM_HORIZON can cause a significant delay before the stream has caught up to real-time. if {AT,AFTER}_SEQUENCE_NUMBER are used, then a sequenceNumberProvider MUST be supplied. There are 4 enums and the value can be one of TRIM_HORIZON, LATEST, AT_SEQUENCE_NUMBER, AFTER_SEQUENCE_NUMBER
- type: String
- x-descriptors:
- - 'urn:alm:descriptor:com.tectonic.ui:checkbox'
+ type: string
default: LATEST
sequenceNumberProvider:
title: Sequence Number Provider
[camel-kamelets] 05/10: Added AWS DDB Streams Source Kamelet
Posted by nf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nferraro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git
commit 6358d8d4ae7f39936c4cdb77b56bbc56b8352b86
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Mar 24 15:09:37 2021 +0100
Added AWS DDB Streams Source Kamelet
---
docs/modules/ROOT/nav.adoc | 2 +-
docs/modules/ROOT/pages/aws-ddb-streams-source.adoc | 4 ++--
2 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/docs/modules/ROOT/nav.adoc b/docs/modules/ROOT/nav.adoc
index 278f4fb..ea98523 100644
--- a/docs/modules/ROOT/nav.adoc
+++ b/docs/modules/ROOT/nav.adoc
@@ -1,5 +1,5 @@
// THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT
-* xref:ROOT:aws-ddb-streams-source.adoc[image:kamelets/aws-ddb-streams-source.svg[] AWS DDB Streams Source]
+* xref:ROOT:aws-ddb-streams-source.adoc[image:kamelets/aws-ddb-streams-source.svg[] AWS DynamoDB Streams Source]
* xref:ROOT:aws-kinesis-source.adoc[image:kamelets/aws-kinesis-source.svg[] AWS Kinesis Source]
* xref:ROOT:aws-s3-source.adoc[image:kamelets/aws-s3-source.svg[] AWS S3 Source]
* xref:ROOT:aws-sqs-fifo-sink.adoc[image:kamelets/aws-sqs-fifo-sink.svg[] AWS SQS FIFO Sink]
diff --git a/docs/modules/ROOT/pages/aws-ddb-streams-source.adoc b/docs/modules/ROOT/pages/aws-ddb-streams-source.adoc
index 0bc95f2..8dd12f3 100644
--- a/docs/modules/ROOT/pages/aws-ddb-streams-source.adoc
+++ b/docs/modules/ROOT/pages/aws-ddb-streams-source.adoc
@@ -1,9 +1,9 @@
// THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT
-= image:kamelets/aws-ddb-streams-source.svg[] AWS DDB Streams Source
+= image:kamelets/aws-ddb-streams-source.svg[] AWS DynamoDB Streams Source
*Provided by: "Apache Software Foundation"*
-Receive events from AWS DDB Streams.
+Receive events from AWS DynamoDB Streams.
== Configuration Options