You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by dongjoon-hyun <gi...@git.apache.org> on 2018/01/25 20:22:19 UTC
[GitHub] spark pull request #20398: [SPARK-23221][SS][TEST] Fix KafkaContinuousSource...
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/20398#discussion_r163957587
--- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaContinuousSourceSuite.scala ---
@@ -87,6 +87,12 @@ class KafkaContinuousSourceTopicDeletionSuite extends KafkaContinuousTest {
class KafkaContinuousSourceStressForDontFailOnDataLossSuite
extends KafkaSourceStressForDontFailOnDataLossSuite {
+
+ override def createSparkSession(): TestSparkSession = {
+ // Set maxRetries to 3 to handle NPE from `poll` when deleting a topic
+ new TestSparkSession(new SparkContext("local[10,3]", "test-sql-context", sparkConf))
--- End diff --
Ur, sorry for this. While you are here, can we use more specific and different names instead `test-sql-context` for both suites?
- `KafkaSourceStressForDontFailOnDataLossSuite`
- `KafkaContinuousSourceStressForDontFailOnDataLossSuite`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org