You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by bu...@apache.org on 2016/01/21 09:33:34 UTC
svn commit: r978214 [1/6] - in /websites/production/camel/content: ./
news.userimage/
Author: buildbot
Date: Thu Jan 21 08:33:33 2016
New Revision: 978214
Log:
Production update by buildbot for camel
Added:
websites/production/camel/content/news.userimage/user-avatar (with props)
Modified:
websites/production/camel/content/aws-ddbstream.html
websites/production/camel/content/book-component-appendix.html
websites/production/camel/content/book-in-one-page.html
websites/production/camel/content/book-tutorials.html
websites/production/camel/content/camel-2170-release.html
websites/production/camel/content/commercial-camel-offerings.html
websites/production/camel/content/crypto-digital-signatures.html
websites/production/camel/content/file2.html
websites/production/camel/content/ftp.html
websites/production/camel/content/mail.html
websites/production/camel/content/news.html
websites/production/camel/content/siteindex.html
websites/production/camel/content/sitemap.html
Modified: websites/production/camel/content/aws-ddbstream.html
==============================================================================
--- websites/production/camel/content/aws-ddbstream.html (original)
+++ websites/production/camel/content/aws-ddbstream.html Thu Jan 21 08:33:33 2016
@@ -88,7 +88,7 @@
<div class="wiki-content maincontent"><h2 id="AWS-DDBSTREAM-DynamoDBStreamComponent">DynamoDB Stream Component</h2><p><strong>Available as of Camel 2.7</strong></p><p>The DynamoDB Stream component supports receiving messages from Amazon DynamoDB Stream service.</p><div class="confluence-information-macro confluence-information-macro-information"><p class="title">Prerequisites</p><span class="aui-icon aui-icon-small aui-iconfont-info confluence-information-macro-icon"></span><div class="confluence-information-macro-body"><p>You must have a valid Amazon Web Services developer account, and be signed up to use Amazon DynamoDB Streams. More information are available at <a shape="rect" class="external-link" href="http://aws.amazon.com/dynamodb/" rel="nofollow">AWS DynamoDB</a></p></div></div><h3 id="AWS-DDBSTREAM-URIFormat">URI Format</h3><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
<script class="brush: java; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[aws-ddbstream://table-name[?options]
]]></script>
-</div></div><p>The stream needs to be created prior to it being used.<br clear="none"> You can append query options to the URI in the following format, ?options=value&option2=value&...</p><h3 id="AWS-DDBSTREAM-URIOptions">URI Options</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Name</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default Value</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Context</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Description</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>amazonDynamoDbStreamsClient</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><code>null</code></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>Consumer</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>Reference to a <code>com.amazonaws.services.kinesis.AmazonDynamoDBStreams</code> in the <a shape="rect" href="
registry.html">Registry</a>.</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>maxMessagesPerPoll</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><code>100</code></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>Consumer</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>Maximum results that will be returned in each poll to the AWS API, Given that the shard iterator is unique to the consumer, changing it shouldn't effect other consumers.</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd"><p>iteratorType</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p><code>LATEST</code></p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>Consumer</p></td><td colspan="1" rowspan="1" class="confluenceTd"><p>One of <code>trim_horizon</code>, <code>latest</code>, <code>after_sequence_number</code>, or <code>at_sequence_number</code>. See <a shape="rect" class="external-link" href="http://docs.aws.amazon.com/dynamodbstr
eams/latest/APIReference/API_GetShardIterator.html" rel="nofollow">http://docs.aws.amazon.com/dynamodbstreams/latest/APIReference/API_GetShardIterator.html</a> for descriptions of these two iterator types.</p></td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">sequenceNumberProvider</td><td colspan="1" rowspan="1" class="confluenceTd">null</td><td colspan="1" rowspan="1" class="confluenceTd">Consumer</td><td colspan="1" rowspan="1" class="confluenceTd">Either a bean reference to an implementation of <code>org.apache.camel.component.aws.ddbstream.SequenceNumberProvider</code> or a literal string representing a sequence number. The role of this is to determine where in the stream to start when using one of the <code>after_sequence_number</code>, or <code>at_sequence_number</code> iterator types.</td></tr></tbody></table></div><div class="confluence-information-macro confluence-information-macro-information"><p class="title">Required DynampDBStream component options</p>
<span class="aui-icon aui-icon-small aui-iconfont-info confluence-information-macro-icon"></span><div class="confluence-information-macro-body"><p>You have to provide the amazonDynamoDbStreamsClient in the <a shape="rect" href="registry.html">Registry</a> with proxies and relevant credentials configured.</p></div></div><h3 id="AWS-DDBSTREAM-SequenceNumbers">Sequence Numbers</h3><p>You can provide a literal string as the sequence number or provide a bean in the registry. An example of using the bean would be to save your current position in the change feed and restore it on Camel startup.</p><p>It is an error to provide a sequence number that is greater than the largest sequence number in the describe-streams result, as this will lead to the AWS call returning an HTTP 400.</p><h3 id="AWS-DDBSTREAM-BatchConsumer">Batch Consumer</h3><p>This component implements the <a shape="rect" href="batch-consumer.html">Batch Consumer</a>.</p><p>This allows you for instance to know how many me
ssages exists in this batch and for instance let the <a shape="rect" href="aggregator.html">Aggregator</a> aggregate this number of messages.</p><h3 id="AWS-DDBSTREAM-Usage">Usage</h3><h4 id="AWS-DDBSTREAM-AmazonDynamoDBStreamsClientconfiguration">AmazonDynamoDBStreamsClient configuration</h4><p>You will need to create an instance of AmazonDynamoDBStreamsClient and bind it to the registry</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
+</div></div><p>The stream needs to be created prior to it being used.<br clear="none"> You can append query options to the URI in the following format, ?options=value&option2=value&...</p><h3 id="AWS-DDBSTREAM-URIOptions">URI Options</h3><div class="table-wrap"><table class="confluenceTable"><tbody><tr><th colspan="1" rowspan="1" class="confluenceTh"><p>Name</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Default Value</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Context</p></th><th colspan="1" rowspan="1" class="confluenceTh"><p>Description</p></th></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">amazonDynamoDbStreamsClient</td><td colspan="1" rowspan="1" class="confluenceTd"><code>null</code></td><td colspan="1" rowspan="1" class="confluenceTd">Consumer</td><td colspan="1" rowspan="1" class="confluenceTd">Reference to a <code>com.amazonaws.services.kinesis.AmazonDynamoDBStreams</code> in the <a shape="rect" href="registry.html">Registry<
/a>.</td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">maxMessagesPerPoll</td><td colspan="1" rowspan="1" class="confluenceTd"><code>100</code></td><td colspan="1" rowspan="1" class="confluenceTd">Consumer</td><td colspan="1" rowspan="1" class="confluenceTd">Maximum results that will be returned in each poll to the AWS API, Given that the shard iterator is unique to the consumer, changing it shouldn't effect other consumers.</td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">iteratorType</td><td colspan="1" rowspan="1" class="confluenceTd"><code>LATEST</code></td><td colspan="1" rowspan="1" class="confluenceTd">Consumer</td><td colspan="1" rowspan="1" class="confluenceTd">One of <code>trim_horizon</code>, <code>latest</code>, <code>after_sequence_number</code>, or <code>at_sequence_number</code>. See <a shape="rect" class="external-link" href="http://docs.aws.amazon.com/dynamodbstreams/latest/APIReference/API_GetShardIterator.html" rel="nofollow">http://docs.a
ws.amazon.com/dynamodbstreams/latest/APIReference/API_GetShardIterator.html</a> for descriptions of these two iterator types.</td></tr><tr><td colspan="1" rowspan="1" class="confluenceTd">sequenceNumberProvider</td><td colspan="1" rowspan="1" class="confluenceTd">null</td><td colspan="1" rowspan="1" class="confluenceTd">Consumer</td><td colspan="1" rowspan="1" class="confluenceTd">Either a bean reference to an implementation of <code>org.apache.camel.component.aws.ddbstream.SequenceNumberProvider</code> or a literal string representing a sequence number. The role of this is to determine where in the stream to start when using one of the <code>after_sequence_number</code>, or <code>at_sequence_number</code> iterator types.</td></tr></tbody></table></div><div class="confluence-information-macro confluence-information-macro-information"><p class="title">Required DynampDBStream component options</p><span class="aui-icon aui-icon-small aui-iconfont-info confluence-information-macro-
icon"></span><div class="confluence-information-macro-body"><p>You have to provide the amazonDynamoDbStreamsClient in the <a shape="rect" href="registry.html">Registry</a> with proxies and relevant credentials configured.</p></div></div><h3 id="AWS-DDBSTREAM-SequenceNumbers">Sequence Numbers</h3><p>You can provide a literal string as the sequence number or provide a bean in the registry. An example of using the bean would be to save your current position in the change feed and restore it on Camel startup.</p><p>It is an error to provide a sequence number that is greater than the largest sequence number in the describe-streams result, as this will lead to the AWS call returning an HTTP 400.</p><h3 id="AWS-DDBSTREAM-BatchConsumer">Batch Consumer</h3><p>This component implements the <a shape="rect" href="batch-consumer.html">Batch Consumer</a>.</p><p>This allows you for instance to know how many messages exists in this batch and for instance let the <a shape="rect" href="aggregato
r.html">Aggregator</a> aggregate this number of messages.</p><h3 id="AWS-DDBSTREAM-Usage">Usage</h3><h4 id="AWS-DDBSTREAM-AmazonDynamoDBStreamsClientconfiguration">AmazonDynamoDBStreamsClient configuration</h4><p>You will need to create an instance of AmazonDynamoDBStreamsClient and bind it to the registry</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeContent panelContent pdl">
<script class="brush: java; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[ClientConfiguration clientConfiguration = new ClientConfiguration();
clientConfiguration.setProxyHost("http://myProxyHost");
clientConfiguration.setProxyPort(8080);
@@ -99,7 +99,7 @@ region.createClient(AmazonDynamoDBStream
registry.bind("kinesisClient", client);
]]></script>
-</div></div><h4 id="AWS-DDBSTREAM-ProvidingAWSCredentials">Providing AWS Credentials</h4><p>It is recommended that the credentials are obtained by using the <a shape="rect" class="external-link" href="http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/auth/DefaultAWSCredentialsProviderChain.html" rel="nofollow">DefaultAWSCredentialsProviderChain</a> that is the default when creating a new ClientConfiguration instance, however, a different <a shape="rect" class="external-link" href="http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/auth/AWSCredentialsProvider.html" rel="nofollow">AWSCredentialsProvider</a> can be specified when calling createClient(...).</p><h3 id="AWS-DDBSTREAM-Dependencies">Dependencies</h3><p>Maven users will need to add the following dependency to their pom.xml.</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeHeader panelHeader pdl" style="border-bottom-width: 1px;"><b>pom.xml</b></div><div class="co
deContent panelContent pdl">
+</div></div><h4 id="AWS-DDBSTREAM-ProvidingAWSCredentials">Providing AWS Credentials</h4><p>It is recommended that the credentials are obtained by using the <a shape="rect" class="external-link" href="http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/auth/DefaultAWSCredentialsProviderChain.html" rel="nofollow">DefaultAWSCredentialsProviderChain</a> that is the default when creating a new ClientConfiguration instance, however, a different <a shape="rect" class="external-link" href="http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/auth/AWSCredentialsProvider.html" rel="nofollow">AWSCredentialsProvider</a> can be specified when calling createClient(...).</p><h3 id="AWS-DDBSTREAM-CopingwithDowntime">Coping with Downtime</h3><h4 id="AWS-DDBSTREAM-AWSDynamoDBStreamsoutageoflessthan24hours">AWS DynamoDB Streams outage of less than 24 hours</h4><p>The consumer will resume from the last seen sequence number (as implemented for <a shape="rect" clas
s="external-link" href="https://issues.apache.org/jira/browse/CAMEL-9515">CAMEL-9515</a>), so you should receive a flood of events in quick succession, as long as the outage did not also include DynamoDB itself.</p><h4 id="AWS-DDBSTREAM-AWSDynamoDBStreamsoutageofmorethan24hours">AWS DynamoDB Streams outage of more than 24 hours</h4><p>Given that AWS only retain 24 hours worth of changes, you will have missed change events no matter what mitigations are in place.</p><h3 id="AWS-DDBSTREAM-Dependencies">Dependencies</h3><p>Maven users will need to add the following dependency to their pom.xml.</p><div class="code panel pdl" style="border-width: 1px;"><div class="codeHeader panelHeader pdl" style="border-bottom-width: 1px;"><b>pom.xml</b></div><div class="codeContent panelContent pdl">
<script class="brush: xml; gutter: false; theme: Default" type="syntaxhighlighter"><![CDATA[<dependency>
<groupId>org.apache.camel</groupId>
<artifactId>camel-aws</artifactId>