You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/10/06 08:55:24 UTC
[spark] branch master updated (4adc282 -> 2793347)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4adc282 [SPARK-33035][SQL] Updates the obsoleted entries of attribute mapping in QueryPlan#transformUpWithNewOutput
add 2793347 [SPARK-32511][SQL] Add dropFields method to Column class
No new revisions were added by this update.
Summary of changes:
.../catalyst/expressions/complexTypeCreator.scala | 127 ++-
.../sql/catalyst/optimizer/ComplexTypes.scala | 20 +-
.../spark/sql/catalyst/optimizer/Optimizer.scala | 6 +-
.../{WithFields.scala => UpdateFields.scala} | 16 +-
...sSuite.scala => CombineUpdateFieldsSuite.scala} | 41 +-
.../sql/catalyst/optimizer/complexTypesSuite.scala | 345 ++++++--
.../benchmarks/UpdateFieldsBenchmark-results.txt | 26 +
.../main/scala/org/apache/spark/sql/Column.scala | 119 ++-
.../apache/spark/sql/ColumnExpressionSuite.scala | 881 +++++++++++++++++++--
.../apache/spark/sql/UpdateFieldsBenchmark.scala | 224 ++++++
10 files changed, 1607 insertions(+), 198 deletions(-)
rename sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/{WithFields.scala => UpdateFields.scala} (68%)
rename sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/{CombineWithFieldsSuite.scala => CombineUpdateFieldsSuite.scala} (65%)
create mode 100644 sql/core/benchmarks/UpdateFieldsBenchmark-results.txt
create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/UpdateFieldsBenchmark.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org