You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2016/11/09 19:03:58 UTC
[jira] [Updated] (SPARK-18373) Make KafkaSource's
failOnDataLoss=false work with Spark jobs
[ https://issues.apache.org/jira/browse/SPARK-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Armbrust updated SPARK-18373:
-------------------------------------
Target Version/s: 2.1.0
> Make KafkaSource's failOnDataLoss=false work with Spark jobs
> ------------------------------------------------------------
>
> Key: SPARK-18373
> URL: https://issues.apache.org/jira/browse/SPARK-18373
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Reporter: Shixiong Zhu
> Assignee: Shixiong Zhu
>
> Right now failOnDataLoss=false doesn't affect Spark jobs launched by KafkaSource. The job may still fail the query when some topics are deleted or some data is aged out. We should handle these corner cases in Spark jobs as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org