You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by vi...@apache.org on 2021/04/02 06:11:05 UTC
[spark] branch master updated (f03c7c0 -> 1fc66f6)
This is an automated email from the ASF dual-hosted git repository.
viirya pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from f03c7c0 [SPARK-34779][CORE] ExecutorMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs
add 1fc66f6 [SPARK-34862][SQL] Support nested column in ORC vectorized reader
No new revisions were added by this update.
Summary of changes:
project/MimaExcludes.scala | 17 ++-
.../org/apache/spark/sql/internal/SQLConf.scala | 10 ++
.../datasources/orc/OrcArrayColumnVector.java | 115 ++++++++++++++++
...olumnVector.java => OrcAtomicColumnVector.java} | 63 ++-------
.../execution/datasources/orc/OrcColumnVector.java | 151 ++-------------------
.../datasources/orc/OrcColumnVectorUtils.java | 71 ++++++++++
.../datasources/orc/OrcColumnarBatchReader.java | 3 +-
.../datasources/orc/OrcMapColumnVector.java | 118 ++++++++++++++++
.../datasources/orc/OrcStructColumnVector.java | 105 ++++++++++++++
.../execution/datasources/orc/OrcFileFormat.scala | 18 ++-
.../execution/datasources/orc/OrcSourceSuite.scala | 29 ++++
11 files changed, 504 insertions(+), 196 deletions(-)
create mode 100644 sql/core/src/main/java/org/apache/spark/sql/execution/datasources/orc/OrcArrayColumnVector.java
copy sql/core/src/main/java/org/apache/spark/sql/execution/datasources/orc/{OrcColumnVector.java => OrcAtomicColumnVector.java} (78%)
create mode 100644 sql/core/src/main/java/org/apache/spark/sql/execution/datasources/orc/OrcColumnVectorUtils.java
create mode 100644 sql/core/src/main/java/org/apache/spark/sql/execution/datasources/orc/OrcMapColumnVector.java
create mode 100644 sql/core/src/main/java/org/apache/spark/sql/execution/datasources/orc/OrcStructColumnVector.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org