You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by we...@apache.org on 2019/11/27 07:38:06 UTC

[spark] branch master updated (4fd585d -> a58d91b)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 4fd585d  [SPARK-30008][SQL] The dataType of collect_list/collect_set aggs should be ArrayType(_, false)
     add a58d91b  [SPARK-29768][SQL] Column pruning through nondeterministic expressions

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/catalyst/planning/patterns.scala     | 101 +++++++++++++++++---
 .../sql/catalyst/planning/ScanOperationSuite.scala | 104 +++++++++++++++++++++
 .../execution/datasources/DataSourceStrategy.scala |   8 +-
 .../execution/datasources/FileSourceStrategy.scala |   4 +-
 .../datasources/v2/V2ScanRelationPushDown.scala    |   4 +-
 .../datasources/FileSourceStrategySuite.scala      |  35 ++++++-
 .../apache/spark/sql/sources/PrunedScanSuite.scala |   4 +
 7 files changed, 235 insertions(+), 25 deletions(-)
 create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/planning/ScanOperationSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org