[GitHub] [spark] MaxGekk commented on a change in pull request #30121: [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to `EXCEPTION` by default

[GitBox <gi...@apache.org>]

MaxGekk commented on a change in pull request #30121:
URL: https://github.com/apache/spark/pull/30121#discussion_r509647076



##########
File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala
##########
@@ -1513,26 +1513,27 @@ class StatisticsSuite extends StatisticsCollectionTestBase with TestHiveSingleto
         Seq(tbl, ext_tbl).foreach { tblName =>
           sql(s"INSERT INTO $tblName VALUES (1, 'a', '2019-12-13')")
 
+          val expectedSize = 636
           // analyze table
           sql(s"ANALYZE TABLE $tblName COMPUTE STATISTICS NOSCAN")
           var tableStats = getTableStats(tblName)
-          assert(tableStats.sizeInBytes == 601)

Review comment:
       The size of the parquet files increased because we write metadata key `org.apache.spark.int96NoRebase`.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org