[jira] [Commented] (SPARK-9335) Kinesis test hits rate limit

["François Garillot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641467#comment-14641467 ] 

François Garillot commented on SPARK-9335:
------------------------------------------

Note those are shard limits enforced by AWS, nothing to do with rate limits that could be part of Spark Streaming.

> Kinesis test hits rate limit
> ----------------------------
>
>                 Key: SPARK-9335
>                 URL: https://issues.apache.org/jira/browse/SPARK-9335
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming, Tests
>            Reporter: Patrick Wendell
>            Assignee: Tathagata Das
>            Priority: Critical
>
> This test is failing many pull request builds because of rate limits:
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38396/testReport/org.apache.spark.streaming.kinesis/KinesisBackedBlockRDDSuite/_It_is_not_a_test_/
> I disabled the test. I wonder if it's better to not have this test run by default since it's a bit brittle to depend on an external system like this (what if Kinesis goes down, for instance, it will block all development).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org