You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2021/01/25 18:11:30 UTC
[spark] branch master updated (bdf71be -> d1177b5)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from bdf71be [SPARK-34218][INFRA] Add Scala 2.13 packaging and publishing
add d1177b5 [SPARK-34192][SQL] Move char padding to write side and remove length check on read side too
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/unsafe/types/UTF8String.java | 1 +
.../sql/catalyst/util/CharVarcharCodegenUtils.java | 57 +++----
.../spark/sql/catalyst/analysis/Analyzer.scala | 77 ++++++++++
.../catalyst/analysis/ResolvePartitionSpec.scala | 2 +-
.../spark/sql/catalyst/util/CharVarcharUtils.scala | 88 ++---------
.../apache/spark/sql/util/PartitioningUtils.scala | 40 ++++-
.../benchmarks/CharVarcharBenchmark-results.txt | 164 +++++++-------------
.../command/AnalyzePartitionCommand.scala | 2 +-
.../apache/spark/sql/execution/command/ddl.scala | 8 +-
.../spark/sql/execution/command/tables.scala | 8 +-
.../PaddingAndLengthCheckForCharVarchar.scala | 139 -----------------
.../spark/sql/execution/datasources/rules.scala | 10 +-
.../execution/datasources/v2/PushDownUtils.scala | 2 +-
.../sql/internal/BaseSessionStateBuilder.scala | 1 -
.../apache/spark/sql/CharVarcharTestSuite.scala | 171 ++++++++++++++++-----
.../execution/benchmark/CharVarcharBenchmark.scala | 57 +------
.../apache/spark/sql/sources/TableScanSuite.scala | 2 +-
.../spark/sql/hive/HiveSessionStateBuilder.scala | 1 -
.../spark/sql/hive/client/HiveClientImpl.scala | 7 +-
19 files changed, 365 insertions(+), 472 deletions(-)
delete mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PaddingAndLengthCheckForCharVarchar.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org