[iceberg] branch master updated: Spark: Fix scanAllFiles in MicroBatch.open (#2667)

[bl...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

blue pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git


The following commit(s) were added to refs/heads/master by this push:
     new 7798094  Spark: Fix scanAllFiles in MicroBatch.open (#2667)
7798094 is described below

commit 7798094e646ce20d67aea2b132ba079a225a1407
Author: chenliang <so...@users.noreply.github.com>
AuthorDate: Sat Jun 19 01:05:00 2021 +0800

    Spark: Fix scanAllFiles in MicroBatch.open (#2667)
    
    Param scanAllFiles Used to check whether all the data files should be processed, or only added files.Here we should replace  scanAllFiles to  !scanAllFiles.
---
 core/src/main/java/org/apache/iceberg/MicroBatches.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/core/src/main/java/org/apache/iceberg/MicroBatches.java b/core/src/main/java/org/apache/iceberg/MicroBatches.java
index d97dc7f..798c337 100644
--- a/core/src/main/java/org/apache/iceberg/MicroBatches.java
+++ b/core/src/main/java/org/apache/iceberg/MicroBatches.java
@@ -242,7 +242,7 @@ public class MicroBatches {
       ManifestGroup manifestGroup = new ManifestGroup(io, ImmutableList.of(manifestFile))
           .specsById(specsById)
           .caseSensitive(caseSensitive);
-      if (scanAllFiles) {
+      if (!scanAllFiles) {
         manifestGroup = manifestGroup
             .filterManifestEntries(entry ->
                 entry.snapshotId() == snapshot.snapshotId() && entry.status() == ManifestEntry.Status.ADDED)