You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by do...@apache.org on 2021/11/02 23:02:09 UTC

[spark] branch master updated (293c085 -> d246010)

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 293c085  [SPARK-36895][SQL][FOLLOWUP] CREATE INDEX command should rely on the analyzer framework to resolve columns
     add d246010  [SPARK-36935][SQL] Extend ParquetSchemaConverter to compute Parquet repetition & definition level

No new revisions were added by this update.

Summary of changes:
 .../java/org/apache/parquet/io/ColumnIOUtil.java}  |   26 +-
 .../parquet/SpecificParquetRecordReaderBase.java   |    2 +
 .../datasources/parquet/ParquetColumn.scala        |   55 +
 .../datasources/parquet/ParquetRowConverter.scala  |   11 +-
 .../parquet/ParquetSchemaConverter.scala           |  198 +++-
 .../datasources/parquet/ParquetSchemaSuite.scala   | 1241 +++++++++++++++++++-
 6 files changed, 1433 insertions(+), 100 deletions(-)
 copy sql/{hive-thriftserver/src/main/java/org/apache/hive/service/cli/OperationStatus.java => core/src/main/java/org/apache/parquet/io/ColumnIOUtil.java} (59%)
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetColumn.scala

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org