You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/06/19 05:57:54 UTC

[spark] branch master updated (17a5007 -> 86b54f3)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 17a5007  [SPARK-30865][SQL][SS] Refactor DateTimeUtils
     add 86b54f3  [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/catalyst/util/UnsafeRowUtils.scala   | 86 ++++++++++++++++++++++
 .../org/apache/spark/sql/internal/SQLConf.scala    | 16 +++-
 .../sql/catalyst/util/UnsafeRowUtilsSuite.scala    | 55 ++++++++++++++
 .../state/HDFSBackedStateStoreProvider.scala       | 13 ++++
 .../sql/execution/streaming/state/StateStore.scala | 33 ++++++++-
 .../execution/streaming/state/StateStoreConf.scala | 19 ++++-
 .../execution/streaming/state/StateStoreRDD.scala  |  5 +-
 .../sql/execution/streaming/state/package.scala    |  6 +-
 .../execution/streaming/statefulOperators.scala    |  6 +-
 9 files changed, 228 insertions(+), 11 deletions(-)
 create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtils.scala
 create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtilsSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org