You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/07/27 03:06:43 UTC
[GitHub] [spark] venkata91 commented on pull request #33350: [SPARK-36136][SQL][TESTS] Refactor PruneFileSourcePartitionsSuite etc to a different package
venkata91 commented on pull request #33350:
URL: https://github.com/apache/spark/pull/33350#issuecomment-887171471
@viirya @sunchao It seems like the refactor caused couple of tests in `PruneFileSourcePartitionsSuite` tests to fail. Seems like the refactor from Hive tables to datasource is causing issues.
I think this test `SPARK-35985 push filters for empty read schema - returns all the files under the partition with DSV2 therefore failing `
`SPARK-36128: spark.sql.hive.metastorePartitionPruning should work for file data sources` - this test checks for `HiveCatalogMetrics.METRIC_PARTITIONS_FETCHED.getCount` since the tests are now moved, this is becoming 0. Please take a look.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org