You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@iceberg.apache.org by bl...@apache.org on 2021/06/25 19:43:44 UTC

[iceberg] branch master updated (c3ac4c6 -> 9cfcf5c)

This is an automated email from the ASF dual-hosted git repository.

blue pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git.


    from c3ac4c6  Spark: Fix check for SQL extensions with extra white space (#2729)
     add 9cfcf5c  Spark: Support micro-batch streaming read for DSv2 (#2660)

No new revisions were added by this update.

Summary of changes:
 .../java/org/apache/iceberg/util/SnapshotUtil.java |  37 ++
 .../iceberg/spark/source/SparkBatchScan.java       |  13 +-
 .../spark/source/SparkMicroBatchStream.java        | 251 +++++++++++++
 .../apache/iceberg/spark/source/SparkTable.java    |   1 +
 .../iceberg/spark/source/StreamingOffset.java      |  39 +-
 .../spark/source/TestStructuredStreamingRead3.java | 406 +++++++++++++++++++++
 6 files changed, 734 insertions(+), 13 deletions(-)
 create mode 100644 spark3/src/main/java/org/apache/iceberg/spark/source/SparkMicroBatchStream.java
 create mode 100644 spark3/src/test/java/org/apache/iceberg/spark/source/TestStructuredStreamingRead3.java