You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by vi...@apache.org on 2021/11/18 01:53:35 UTC

[spark] branch master updated (6450f6b -> b9a0c56)

This is an automated email from the ASF dual-hosted git repository.

viirya pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 6450f6b  [SPARK-37230][DOCS][PYTHON] Document DataFrame.mapInArrow in PySpark documentation
     add b9a0c56  [SPARK-36646][SQL] Push down group by partition column for aggregate

No new revisions were added by this update.

Summary of changes:
 .../datasources/AggregatePushDownUtils.scala       | 66 +++++++++++++++++++--
 .../sql/execution/datasources/orc/OrcUtils.scala   | 29 +++++++---
 .../datasources/parquet/ParquetUtils.scala         | 32 +++++++----
 .../v2/orc/OrcPartitionReaderFactory.scala         | 21 +++----
 .../v2/parquet/ParquetPartitionReaderFactory.scala |  9 +--
 .../FileSourceAggregatePushDownSuite.scala         | 67 ++++++++++++++++++++++
 6 files changed, 187 insertions(+), 37 deletions(-)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org