You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by ac...@apache.org on 2021/04/21 13:15:15 UTC

[camel-kamelets] branch main updated (89138f6 -> 4c2b105)

This is an automated email from the ASF dual-hosted git repository.

acosentino pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git.


    from 89138f6  Moving from master branch to main
     new 2f5c4cf  Added AWS Kinesis Sink Kamelet
     new 29a1884  Added AWS Kinesis Sink Kamelet
     new 4c2b105  Added AWS Kinesis Sink Kamelet

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 ...e.kamelet.yaml => aws-kinesis-sink.kamelet.yaml | 65 +++++++++++++++++-----
 ...aws-kinesis-source.svg => aws-kinesis-sink.svg} |  0
 docs/modules/ROOT/nav.adoc                         |  1 +
 ...s-kinesis-source.adoc => aws-kinesis-sink.adoc} | 46 +++++++++------
 4 files changed, 82 insertions(+), 30 deletions(-)
 copy aws-kinesis-source.kamelet.yaml => aws-kinesis-sink.kamelet.yaml (65%)
 copy docs/modules/ROOT/assets/images/kamelets/{aws-kinesis-source.svg => aws-kinesis-sink.svg} (100%)
 copy docs/modules/ROOT/pages/{aws-kinesis-source.adoc => aws-kinesis-sink.adoc} (60%)

[camel-kamelets] 02/03: Added AWS Kinesis Sink Kamelet

Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

acosentino pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git

commit 29a1884967dcccab1128e2b2c407eee577642253
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Apr 21 14:18:09 2021 +0200

    Added AWS Kinesis Sink Kamelet
---
 docs/modules/ROOT/nav.adoc | 1 +
 1 file changed, 1 insertion(+)

diff --git a/docs/modules/ROOT/nav.adoc b/docs/modules/ROOT/nav.adoc
index ae933ff..c85a314 100644
--- a/docs/modules/ROOT/nav.adoc
+++ b/docs/modules/ROOT/nav.adoc
@@ -1,6 +1,7 @@
 // THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT
 * xref:ROOT:aws-ddb-streams-source.adoc[image:kamelets/aws-ddb-streams-source.svg[] AWS DynamoDB Streams Source]
 * xref:ROOT:aws-kinesis-firehose-sink.adoc[image:kamelets/aws-kinesis-firehose-sink.svg[] AWS Kinesis Firehose Sink]
+* xref:ROOT:aws-kinesis-sink.adoc[image:kamelets/aws-kinesis-sink.svg[] AWS Kinesis Sink]
 * xref:ROOT:aws-kinesis-source.adoc[image:kamelets/aws-kinesis-source.svg[] AWS Kinesis Source]
 * xref:ROOT:aws-lambda-sink.adoc[image:kamelets/aws-lambda-sink.svg[] AWS Lambda Sink]
 * xref:ROOT:aws-s3-sink.adoc[image:kamelets/aws-s3-sink.svg[] AWS S3 Sink]

[camel-kamelets] 01/03: Added AWS Kinesis Sink Kamelet

Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

acosentino pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git

commit 2f5c4cf4a0dc5b8b9eb7ad57050f9af0a7b6b7eb
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Apr 21 14:17:34 2021 +0200

    Added AWS Kinesis Sink Kamelet
---
 aws-kinesis-sink.kamelet.yaml | 92 +++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 92 insertions(+)

diff --git a/aws-kinesis-sink.kamelet.yaml b/aws-kinesis-sink.kamelet.yaml
new file mode 100644
index 0000000..50ac834
--- /dev/null
+++ b/aws-kinesis-sink.kamelet.yaml
@@ -0,0 +1,92 @@
+apiVersion: camel.apache.org/v1alpha1
+kind: Kamelet
+metadata:
+  name: aws-kinesis-sink
+  annotations:
+    camel.apache.org/kamelet.icon: "data:image/svg+xml;base64,PHN2ZyBpZD0iTGF5ZXJfMSIgZGF0YS1uYW1lPSJMYXllciAxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHZpZXdCb3g9IjAgMCAyNTYgMzA4LjIzNDAxIj48dGl0bGU+YXdzLWtpbmVzaXM8L3RpdGxlPjxwYXRoIGQ9Ik0wLDE3Mi4wODdsMTI3Ljc1NCw1OC44MSwxMjcuNzUyLTU4LjgxLTEyNy43NTItNS4yOTNaIiB0cmFuc2Zvcm09InRyYW5zbGF0ZSgwIDAuMDAwMDUpIiBmaWxsPSIjZmNiZjkyIi8+PHBhdGggZD0iTTEyOC4xNDcsMCwuMDU5LDYzLjg4MXY5MC4xMzZIMTUzLjY0OFYxMi43NTFaIiB0cmFuc2Zvcm09InRyYW5zbGF0ZSgwIDAuMD [...]
+    camel.apache.org/provider: "Apache Software Foundation"
+  labels:
+    camel.apache.org/kamelet.type: sink
+spec:
+  definition:
+    title: "AWS Kinesis Sink"
+    description: |-
+      Send data to AWS Kinesis.
+
+      The Kamelet expects the following header:
+
+      - `partition` / `ce-partition`: to set the Kinesis partition key
+
+      If the header won't be set the exchange ID will be used.
+
+      The Kamelet is also able to recognize the following header:
+
+      - `sequence-number` / `ce-sequence-number`: to set the Sequence number
+
+      This header is optional.
+    required:
+      - stream
+      - accessKey
+      - secretKey
+      - region
+    properties:
+      stream:
+        title: Stream Name
+        description: The Kinesis stream that you want to access (needs to be created in advance)
+        type: string
+      accessKey:
+        title: Access Key
+        description: The access key obtained from AWS
+        type: string
+        x-descriptors:
+        - urn:alm:descriptor:com.tectonic.ui:password
+      secretKey:
+        title: Secret Key
+        description: The secret key obtained from AWS
+        type: string
+        x-descriptors:
+        - urn:alm:descriptor:com.tectonic.ui:password
+      region:
+        title: AWS Region
+        description: The AWS region to connect to (capitalized name)
+        type: string
+        example: eu-west-1
+  flow:
+    from:
+      uri: kamelet:source
+      steps:
+      - choice:
+          when:
+          - simple: "${header[partition]}"
+            steps:
+            - set-header:
+                name: CamelAwsKinesisPartitionKey
+                simple: "${header[partition]}"
+          - simple: "${header[ce-partition]}"
+            steps:
+            - set-header:
+                name: CamelAwsKinesisPartitionKey
+                simple: "${header[ce-partition]}"
+          otherwise:
+            steps:
+            - set-property:
+                name: CamelAwsKinesisPartitionKey
+                simple: "${exchangeId}"
+      - choice:
+          when:
+          - simple: "${header[sequence-number]}"
+            steps:
+            - set-header:
+                name: CamelAwsKinesisSequenceNumber
+                simple: "${header[sequence-number]}"
+          - simple: "${header[ce-sequence-number]}"
+            steps:
+            - set-header:
+                name: CamelAwsKinesisSequenceNumber
+                simple: "${header[ce-sequence-number]}"
+      - to:
+          uri: "aws2-kinesis:{{stream}}"
+          parameters:
+            secretKey: "{{secretKey}}"
+            accessKey: "{{accessKey}}"
+            region: "{{region}}"

[camel-kamelets] 03/03: Added AWS Kinesis Sink Kamelet

Posted by ac...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

acosentino pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/camel-kamelets.git

commit 4c2b1050a62b1f3ad1d45f605d56b29438843c77
Author: Andrea Cosentino <an...@gmail.com>
AuthorDate: Wed Apr 21 14:18:52 2021 +0200

    Added AWS Kinesis Sink Kamelet
---
 .../assets/images/kamelets/aws-kinesis-sink.svg    |  1 +
 docs/modules/ROOT/pages/aws-kinesis-sink.adoc      | 78 ++++++++++++++++++++++
 2 files changed, 79 insertions(+)

diff --git a/docs/modules/ROOT/assets/images/kamelets/aws-kinesis-sink.svg b/docs/modules/ROOT/assets/images/kamelets/aws-kinesis-sink.svg
new file mode 100644
index 0000000..26ddfef
--- /dev/null
+++ b/docs/modules/ROOT/assets/images/kamelets/aws-kinesis-sink.svg
@@ -0,0 +1 @@
+<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 256 308.23401"><title>aws-kinesis</title><path d="M0,172.087l127.754,58.81,127.752-58.81-127.752-5.293Z" transform="translate(0 0.00005)" fill="#fcbf92"/><path d="M128.147,0,.059,63.881v90.136H153.648V12.751Z" transform="translate(0 0.00005)" fill="#9d5025"/><path d="M.059,217.559l128.162,90.675L256,217.559,127.945,198.926Z" transform="translate(0 0.00005)" fill="#fcbf92"/><path d="M128.146,154.017h67.5 [...]
\ No newline at end of file
diff --git a/docs/modules/ROOT/pages/aws-kinesis-sink.adoc b/docs/modules/ROOT/pages/aws-kinesis-sink.adoc
new file mode 100644
index 0000000..17130d7
--- /dev/null
+++ b/docs/modules/ROOT/pages/aws-kinesis-sink.adoc
@@ -0,0 +1,78 @@
+// THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT
+= image:kamelets/aws-kinesis-sink.svg[] AWS Kinesis Sink
+
+*Provided by: "Apache Software Foundation"*
+
+Send data to AWS Kinesis.
+
+The Kamelet expects the following header:
+
+- `partition` / `ce-partition`: to set the Kinesis partition key
+
+If the header won't be set the exchange ID will be used.
+
+The Kamelet is also able to recognize the following header:
+
+- `sequence-number` / `ce-sequence-number`: to set the Sequence number
+
+This header is optional.
+
+== Configuration Options
+
+The following table summarizes the configuration options available for the `aws-kinesis-sink` Kamelet:
+[width="100%",cols="2,^2,3,^2,^2,^3",options="header"]
+|===
+| Property| Name| Description| Type| Default| Example
+| *accessKey {empty}* *| Access Key| The access key obtained from AWS| string| | 
+| *region {empty}* *| AWS Region| The AWS region to connect to (capitalized name)| string| | `"eu-west-1"`
+| *secretKey {empty}* *| Secret Key| The secret key obtained from AWS| string| | 
+| *stream {empty}* *| Stream Name| The Kinesis stream that you want to access (needs to be created in advance)| string| | 
+|===
+
+NOTE: Fields marked with ({empty}*) are mandatory.
+
+== Usage
+
+This section summarizes how the `aws-kinesis-sink` can be used in various contexts.
+
+=== Knative Sink
+
+The `aws-kinesis-sink` Kamelet can be used as Knative sink by binding it to a Knative object.
+
+.aws-kinesis-sink-binding.yaml
+[source,yaml]
+----
+apiVersion: camel.apache.org/v1alpha1
+kind: KameletBinding
+metadata:
+  name: aws-kinesis-sink-binding
+spec:
+  source:
+    ref:
+      kind: InMemoryChannel
+      apiVersion: messaging.knative.dev/v1
+      name: mychannel
+  sink:
+    ref:
+      kind: Kamelet
+      apiVersion: camel.apache.org/v1alpha1
+      name: aws-kinesis-sink
+    properties:
+      accessKey: "The Access Key"
+      region: "eu-west-1"
+      secretKey: "The Secret Key"
+      stream: "The Stream Name"
+
+----
+
+Make sure you have xref:latest@camel-k::installation/installation.adoc[Camel K installed] into the Kubernetes cluster you're connected to.
+
+Save the `aws-kinesis-sink-binding.yaml` file into your hard drive, then configure it according to your needs.
+
+You can run the sink using the following command:
+
+[source,shell]
+----
+kubectl apply -f aws-kinesis-sink-binding.yaml
+----
+// THIS FILE IS AUTOMATICALLY GENERATED: DO NOT EDIT