You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by aravias <as...@homeaway.com> on 2017/06/09 15:21:33 UTC

Re: StructuredStreaming : StreamingQueryException

this is a bug in spark version 2.1.0, seems to be fixed in spark 2.1.1 when
ran  with that version.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/StructuredStreaming-StreamingQueryException-tp28749p28753.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Re: StructuredStreaming : StreamingQueryException

Posted by aravias <as...@homeaway.com>.
the bug is related to where long checkpoints are truncated when dealing with
topics have large number of partitions, in my case 120.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/StructuredStreaming-StreamingQueryException-tp28749p28754.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org