[GitHub] nandorKollar edited a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

[GitBox <gi...@apache.org>]

nandorKollar edited a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one
URL: https://github.com/apache/spark/pull/23721#issuecomment-462791845
 
 
   @dongjoon-hyun @squito triaged the failures:
   * InMemoryColumnarQuerySuite - failed because of change in Parquet file size due to column indexes
   * ParquetInteroperabilitySuite "parquet timestamp read path" - _had to regenerate test Parquet files, those which are attached to the PR were generated before RC_
   * HadoopFsRelationSuite "SPARK-22790: spark.sql.sources.compressionFactor takes effect" - _failed because of change in Parquet file size, due to column indexes_
   * ParquetPartitionDiscoverySuite "column type inference" & "parse partitions" - _couldn't reproduce test locally, it passes on my machine_
   * HDFSMetadataLogSuite "HDFSMetadataLog: metadata directory collision" - _couldn't reproduce, in Jenkins logs I could see "The await method on Waiter timed out.", maybe it is a flaky test? Looks like an unrelated failure for me._
   * ParquetQuerySuite "SPARK-26677: negated null-safe equality comparison should not filter matched row groups" - _fails because PARQUET-1510 is not yet included into 1.11.0 RC3, RC4 is needed (this bug was found after RC3 was created)_

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org