You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/11/08 08:01:00 UTC
[jira] [Assigned] (SPARK-25971) Ignore partition byte-size
statistics in SQLQueryTestSuite
[ https://issues.apache.org/jira/browse/SPARK-25971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-25971:
------------------------------------
Assignee: Apache Spark
> Ignore partition byte-size statistics in SQLQueryTestSuite
> ----------------------------------------------------------
>
> Key: SPARK-25971
> URL: https://issues.apache.org/jira/browse/SPARK-25971
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Dongjoon Hyun
> Assignee: Apache Spark
> Priority: Minor
>
> Currently, `SQLQueryTestSuite` is sensitive in terms of the bytes of parquet files in table partitions. If we change the default file format (from Parquet to ORC) or update the metadata of them, the test case should be changed accordingly. This issue aims to make `SQLQueryTestSuite` more robust by ignoring the partition byte statistics.
> {code}
> -Partition Statistics 1144 bytes, 2 rows
> +Partition Statistics [not included in comparison] bytes, 2 rows
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org