You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2018/11/08 11:42:00 UTC
[jira] [Resolved] (SPARK-25971) Ignore partition byte-size
statistics in SQLQueryTestSuite
[ https://issues.apache.org/jira/browse/SPARK-25971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-25971.
-----------------------------------
Resolution: Fixed
Assignee: Dongjoon Hyun
Fix Version/s: 3.0.0
This is resolved via https://github.com/apache/spark/pull/22972
> Ignore partition byte-size statistics in SQLQueryTestSuite
> ----------------------------------------------------------
>
> Key: SPARK-25971
> URL: https://issues.apache.org/jira/browse/SPARK-25971
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Minor
> Fix For: 3.0.0
>
>
> Currently, `SQLQueryTestSuite` is sensitive in terms of the bytes of parquet files in table partitions. If we change the default file format (from Parquet to ORC) or update the metadata of them, the test case should be changed accordingly. This issue aims to make `SQLQueryTestSuite` more robust by ignoring the partition byte statistics.
> {code}
> -Partition Statistics 1144 bytes, 2 rows
> +Partition Statistics [not included in comparison] bytes, 2 rows
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org