You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/12/29 13:00:06 UTC
[spark] branch master updated (2627825 -> f9fe742)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 2627825 [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job
add f9fe742 [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs
No new revisions were added by this update.
Summary of changes:
.../sql/catalyst/expressions/csvExpressions.scala | 12 ++-
.../catalyst/optimizer/OptimizeCsvJsonExprs.scala | 120 +++++++++++++++++++++
.../sql/catalyst/optimizer/OptimizeJsonExprs.scala | 96 -----------------
.../spark/sql/catalyst/optimizer/Optimizer.scala | 2 +-
.../org/apache/spark/sql/internal/SQLConf.scala | 10 ++
.../catalyst/optimizer/OptimizeCsvExprsSuite.scala | 83 ++++++++++++++
.../optimizer/OptimizeJsonExprsSuite.scala | 2 +-
.../org/apache/spark/sql/CsvFunctionsSuite.scala | 48 +++++++++
8 files changed, 272 insertions(+), 101 deletions(-)
create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeCsvJsonExprs.scala
delete mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeJsonExprs.scala
create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeCsvExprsSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org