You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/10/29 14:47:41 UTC
[spark] branch master updated (b409025 -> 056b622)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from b409025 [SPARK-33281][SQL] Return SQL schema instead of Catalog string from the `SchemaOfCsv` expression
add 056b622 [SPARK-33263][SS] Configurable StateStore compression codec
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/sql/internal/SQLConf.scala | 12 +++
.../spark/sql/execution/streaming/OffsetSeq.scala | 10 ++-
.../state/HDFSBackedStateStoreProvider.scala | 8 +-
.../execution/streaming/state/StateStoreConf.scala | 3 +
.../commits/0 | 0
.../metadata | 1 +
.../offsets/0 | 3 +
.../state/0/0/1.delta | Bin 0 -> 85 bytes
.../state/StateStoreCompatibilitySuite.scala | 84 +++++++++++++++++++++
.../streaming/state/StateStoreSuite.scala | 13 ++--
10 files changed, 123 insertions(+), 11 deletions(-)
copy sql/core/src/test/resources/structured-streaming/{escaped-path-2.4.0/chk%252520%252525@%252523chk => checkpoint-version-3.0.0-streaming-statestore-codec}/commits/0 (100%)
create mode 100644 sql/core/src/test/resources/structured-streaming/checkpoint-version-3.0.0-streaming-statestore-codec/metadata
create mode 100644 sql/core/src/test/resources/structured-streaming/checkpoint-version-3.0.0-streaming-statestore-codec/offsets/0
create mode 100644 sql/core/src/test/resources/structured-streaming/checkpoint-version-3.0.0-streaming-statestore-codec/state/0/0/1.delta
create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreCompatibilitySuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org