You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/12/29 13:00:06 UTC

[spark] branch master updated (2627825 -> f9fe742)

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 2627825  [SPARK-33931][INFRA] Recover GitHub Action `build_and_test` job
     add f9fe742  [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs

No new revisions were added by this update.

Summary of changes:
 .../sql/catalyst/expressions/csvExpressions.scala  |  12 ++-
 .../catalyst/optimizer/OptimizeCsvJsonExprs.scala  | 120 +++++++++++++++++++++
 .../sql/catalyst/optimizer/OptimizeJsonExprs.scala |  96 -----------------
 .../spark/sql/catalyst/optimizer/Optimizer.scala   |   2 +-
 .../org/apache/spark/sql/internal/SQLConf.scala    |  10 ++
 .../catalyst/optimizer/OptimizeCsvExprsSuite.scala |  83 ++++++++++++++
 .../optimizer/OptimizeJsonExprsSuite.scala         |   2 +-
 .../org/apache/spark/sql/CsvFunctionsSuite.scala   |  48 +++++++++
 8 files changed, 272 insertions(+), 101 deletions(-)
 create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeCsvJsonExprs.scala
 delete mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeJsonExprs.scala
 create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeCsvExprsSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org