You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/11/08 07:57:00 UTC

[jira] [Created] (SPARK-25971) Ignore partition byte-size statistics in SQLQueryTestSuite

Dongjoon Hyun created SPARK-25971:
-------------------------------------

             Summary: Ignore partition byte-size statistics in SQLQueryTestSuite
                 Key: SPARK-25971
                 URL: https://issues.apache.org/jira/browse/SPARK-25971
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Dongjoon Hyun


Currently, `SQLQueryTestSuite` is sensitive in terms of the bytes of parquet files in table partitions. If we change the default file format (from Parquet to ORC) or update the metadata of them, the test case should be changed accordingly. This issue aims to make `SQLQueryTestSuite` more robust by ignoring the partition byte statistics.

{code}
-Partition Statistics   1144 bytes, 2 rows
+Partition Statistics   [not included in comparison] bytes, 2 rows
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org