You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Marcelo Vanzin (Jira)" <ji...@apache.org> on 2019/08/26 20:13:00 UTC

[jira] [Resolved] (SPARK-28875) Cover Task retry scenario with test in Kafka connector

     [ https://issues.apache.org/jira/browse/SPARK-28875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin resolved SPARK-28875.
------------------------------------
    Fix Version/s: 3.0.0
       Resolution: Fixed

Issue resolved by pull request 25582
[https://github.com/apache/spark/pull/25582]

> Cover Task retry scenario with test in Kafka connector
> ------------------------------------------------------
>
>                 Key: SPARK-28875
>                 URL: https://issues.apache.org/jira/browse/SPARK-28875
>             Project: Spark
>          Issue Type: Improvement
>          Components: DStreams, Structured Streaming, Tests
>    Affects Versions: 3.0.0
>            Reporter: Gabor Somogyi
>            Assignee: Gabor Somogyi
>            Priority: Minor
>             Fix For: 3.0.0
>
>
> When Task retry happens with Kafka source then it's not known whether the consumer is the issue so the old consumer removed from cache and new consumer created. The feature works fine but not covered with tests.
>  



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org