You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gabor Somogyi (JIRA)" <ji...@apache.org> on 2018/11/29 18:48:00 UTC

[jira] [Created] (SPARK-26220) Flaky Test: org.apache.spark.sql.kafka010.KafkaSourceStressSuite

Gabor Somogyi created SPARK-26220:
-------------------------------------

             Summary: Flaky Test: org.apache.spark.sql.kafka010.KafkaSourceStressSuite
                 Key: SPARK-26220
                 URL: https://issues.apache.org/jira/browse/SPARK-26220
             Project: Spark
          Issue Type: New Feature
          Components: Tests
    Affects Versions: 3.0.0
            Reporter: Gabor Somogyi


There was a kafka-clients version update lately and I've seen a test failure like this (rarely comes):
{code:java}
KafkaRelationSuite:
- explicit earliest to latest offsets
- default starting and ending offsets
- explicit offsets
- reuse same dataframe in query
- test late binding start offsets
- bad batch query options
- read Kafka transactional messages: read_committed
- read Kafka transactional messages: read_uncommitted
KafkaSourceStressSuite:
- stress test with multiple topics and partitions *** FAILED ***
  == Results ==
  !== Correct Answer - 49 ==   == Spark Answer - 45 ==
   struct<value:int>           struct<value:int>
   [10]                        [10]
   [11]                        [11]
   [12]                        [12]
   [13]                        [13]
   [14]                        [14]
   [15]                        [15]
   [16]                        [16]
   [17]                        [17]
   [18]                        [18]
   [19]                        [19]
   [1]                         [1]
   [20]                        [20]
   [21]                        [21]
   [22]                        [22]
   [23]                        [23]
   [24]                        [24]
   [25]                        [25]
   [26]                        [26]
  ![27]                        [2]
  ![28]                        [31]
  ![29]                        [32]
  ![2]                         [33]
  ![30]                        [34]
  ![31]                        [35]
  ![32]                        [36]
  ![33]                        [37]
  ![34]                        [38]
  ![35]                        [39]
  ![36]                        [3]
  ![37]                        [40]
  ![38]                        [41]
  ![39]                        [42]
  ![3]                         [43]
  ![40]                        [44]
  ![41]                        [45]
  ![42]                        [46]
  ![43]                        [47]
  ![44]                        [48]
  ![45]                        [49]
  ![46]                        [4]
  ![47]                        [5]
  ![48]                        [6]
  ![49]                        [7]
  ![4]                         [8]
  ![5]                         [9]
  ![6]
  ![7]
  ![8]
  ![9]
{code}




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org