You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Chris Fregly (JIRA)" <ji...@apache.org> on 2015/04/07 04:30:13 UTC

[jira] [Commented] (SPARK-6514) For Kinesis Streaming, use the same region for DynamoDB (KCL checkpoints) as the Kinesis stream itself

    [ https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482455#comment-14482455 ] 

Chris Fregly commented on SPARK-6514:
-------------------------------------

we may want to inspect the streamURL for the region

otherwise, we would need to make the new regionName param be more explicit about its meaning.  ie. dynamoRegion, but this exposes the implementation which is not good.

> For Kinesis Streaming, use the same region for DynamoDB (KCL checkpoints) as the Kinesis stream itself  
> --------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-6514
>                 URL: https://issues.apache.org/jira/browse/SPARK-6514
>             Project: Spark
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 1.3.0
>            Reporter: Chris Fregly
>
> context:  i started the original Kinesis impl with KCL 1.0 (not supported), then finished on KCL 1.1 (supported) without realizing that it's supported.
> also, we should upgrade to the latest Kinesis Client Library (KCL) which is currently v1.2 right now, i believe.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org