You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Alex Mikhailau (JIRA)" <ji...@apache.org> on 2017/10/04 14:46:02 UTC

[jira] [Created] (SPARK-22200) Kinesis Receivers stops if Kinesis stream was re-sharded

Alex Mikhailau created SPARK-22200:
--------------------------------------

             Summary: Kinesis Receivers stops if Kinesis stream was re-sharded
                 Key: SPARK-22200
                 URL: https://issues.apache.org/jira/browse/SPARK-22200
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.2.0
            Reporter: Alex Mikhailau
            Priority: Critical


Seeing 

Cannot find the shard given the shardId shardId-000000004454

Cannot get the shard for this ProcessTask, so duplicate KPL user records in the event of resharding will not be dropped during deaggregation of Amazon Kinesis records.

after Kinesis stream re-sharding and receivers stop working altogether.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org