You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by gu...@apache.org on 2020/05/04 06:31:14 UTC

[spark] branch master updated (7ef0b69 -> f72220b)

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 7ef0b69  [SPARK-31626][SQL] Port HIVE-10415: hive.start.cleanup.scratchdir configuration is not taking effect
     add f72220b  [SPARK-31606][SQL] Reduce the perf regression of vectorized parquet reader caused by datetime rebase

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/catalyst/util/RebaseDateTime.scala   |   4 +
 .../DateTimeRebaseBenchmark-jdk11-results.txt      | 104 ++++++++++-----------
 .../benchmarks/DateTimeRebaseBenchmark-results.txt | 104 ++++++++++-----------
 .../parquet/VectorizedColumnReader.java            |  22 +----
 .../parquet/VectorizedPlainValuesReader.java       |  55 +++++++++++
 .../parquet/VectorizedRleValuesReader.java         |  85 +++++++++++++++++
 .../parquet/VectorizedValuesReader.java            |   2 +
 .../benchmark/DateTimeRebaseBenchmark.scala        |  79 ++++++++--------
 8 files changed, 295 insertions(+), 160 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org