You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/02/02 22:46:10 UTC

[GitHub] [hudi] alexeykudinkin opened a new pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

alexeykudinkin opened a new pull request #4739:
URL: https://github.com/apache/hudi/pull/4739


   ## *Tips*
   - *Thank you very much for contributing to Apache Hudi.*
   - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
   
   ## What is the purpose of the pull request
   
   This change makes sure MT records are updated appropriately on HDFS: previously after Log File append operations MT records were updated w/ just the size of the deltas being appended to the original files, which have been found to be the cause of issues in case of Rollbacks that were instead updating MT with records bearing the full file-size.
   
   To make sure that we hedge against similar issues going f/w, this PR alleviates this discrepancy and streamlines the flow of MT table always ingesting records bearing full file-sizes.
   
   ## Brief change log
   
    - Refactored MT records composition from HoodieCommitMetadata to always operate on full file-sizes
    - Fixed HoodieMetadataPayload to properly combine file-sizes
   
   ## Verify this pull request
   
   This pull request is already covered by existing tests, such as *(please describe tests)*.
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054929428


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030427493


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802159013



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       ok, let me take a stab to see if this is a valid scenario. this could be applicable only for hdfs.
   
   Let's say there is a concurrent write to a log file by two diff writers. one of them is doing a rollback and another is appending a log block. Let's say writer1 (who is doing a rollback) updates the log file first and gets size as 200 may be. And later writer2 appends to same log file and gets size as 300. Even though the order in which these writers appended to file could be writer1 followed by writer2. Its not guaranteed that the same order will be maintained when they reach metadata table. So, due to various reasons writer2 could complete its write earlier(for eg writer2 is updating only one file group, where as writer1 is updating some 100 file groups) and could apply its changes to metadata first before writer1. 
   
   wouldn't the final resolved size from metadata be 200 in this case when both writers are done updating MDT? 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802179203



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       You've brought up interesting point. First of all, MT updates and actual FS changes are actually part of the `commit` operation which is atomic (as in: it's performed under lock). 
   
   But if extend your train of thought, and assume for a moment that it could be possible that MT updates and FS operations aren't atomic, we actually _will not be able_ to guarantee consistency b/w actual state of the FS and MT, b/c at any point MT operations (accompanying actual FS ops) could get re-ordered which practically would entail that we will potentially have incorrect MT state b/c "merge" of MT records is not a commutative operation (b/c it inherently relies on ordering for deletes). Example of such inconsistency would be "resurrecting file" where (in order)
   
   1. File F is Appended (A_1)
   2. File F is Deleted (D_1)
   3. MT record (deleted=true) is added (for D_1)
   4. MT record (size=..., deleted=false) is added (for A_1)
   
   Therefore, we will have to provide for such atomicity (which we do)




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041295531


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041939619


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042493915


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1043921147


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1033327350


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1044049107


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049393643


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051413537


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051369841


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051552922


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r818168349



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -1301,4 +1369,33 @@ public void close() {
     this.heartbeatClient.stop();
     this.txnManager.close();
   }
+
+  private void setWriteTimer(HoodieTable<T, I, K, O> table) {
+    String commitType = table.getMetaClient().getCommitActionType();
+    if (commitType.equals(HoodieTimeline.COMMIT_ACTION)) {
+      writeTimer = metrics.getCommitCtx();
+    } else if (commitType.equals(HoodieTimeline.DELTA_COMMIT_ACTION)) {
+      writeTimer = metrics.getDeltaCommitCtx();
+    }
+  }
+
+  private void tryUpgrade(HoodieTableMetaClient metaClient, Option<String> instantTime) {
+    UpgradeDowngrade upgradeDowngrade =
+        new UpgradeDowngrade(metaClient, config, context, upgradeDowngradeHelper);
+
+    if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {

Review comment:
       I don't think this is accurate -- Flink is also using `UpgradeDowngrade`. Only Java-engine didn't have corresponding helper which i've bootstrapped in here, otherwise code of the `UpgradeDowngrade` itself is engine-agnostic.
   
   Can you please elaborate what your concern around it is? 
   
   Frankly, am not a fan that i had to do budge this refactoring in this PR, but after adding validations into `HoodieMetadataPayload` -- tests started to fail b/c we were not init'ing MT appropriately, so i had to address that holistically across all engines.

##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -1246,17 +1243,88 @@ public HoodieMetrics getMetrics() {
   }
 
   /**
-   * Get HoodieTable and init {@link Timer.Context}.
+   * Instantiates engine-specific instance of {@link HoodieTable} as well as performs necessary
+   * bootstrapping operations (for ex, validating whether Metadata Table has to be bootstrapped)
    *
-   * @param operationType write operation type
+   * NOTE: THIS OPERATION IS EXECUTED UNDER LOCK, THEREFORE SHOULD AVOID ANY OPERATIONS
+   *       NOT REQUIRING EXTERNAL SYNCHRONIZATION
+   *
+   * @param metaClient instance of {@link HoodieTableMetaClient}
    * @param instantTime current inflight instant time
-   * @return HoodieTable
+   * @return instantiated {@link HoodieTable}
    */
-  protected abstract HoodieTable<T, I, K, O> getTableAndInitCtx(WriteOperationType operationType, String instantTime);
+  protected abstract HoodieTable<T, I, K, O> doInitTable(HoodieTableMetaClient metaClient, Option<String> instantTime);
 
   /**
-   * Sets write schema from last instant since deletes may not have schema set in the config.
+   * Instantiates and initializes instance of {@link HoodieTable}, performing crucial bootstrapping
+   * operations such as:
+   *
+   * NOTE: This method is engine-agnostic and SHOULD NOT be overloaded, please check on
+   * {@link #doInitTable(HoodieTableMetaClient, Option<String>)} instead
+   *
+   * <ul>
+   *   <li>Checking whether upgrade/downgrade is required</li>
+   *   <li>Bootstrapping Metadata Table (if required)</li>
+   *   <li>Initializing metrics contexts</li>
+   * </ul>
    */
+  protected final HoodieTable<T, I, K, O> initTable(WriteOperationType operationType, Option<String> instantTime) {
+    HoodieTableMetaClient metaClient = createMetaClient(true);
+    // Setup write schemas for deletes
+    if (operationType == WriteOperationType.DELETE) {
+      setWriteSchemaForDeletes(metaClient);
+    }
+
+    HoodieTable<T, I, K, O> table;
+
+    this.txnManager.beginTransaction();
+    try {
+      tryUpgrade(metaClient, instantTime);
+      table = doInitTable(metaClient, instantTime);
+    } finally {
+      this.txnManager.endTransaction();
+    }
+
+    // Validate table properties
+    metaClient.validateTableProperties(config.getProps(), operationType);
+    // Make sure that FS View is in sync
+    table.getHoodieView().sync();
+
+    switch (operationType) {
+      case INSERT:
+      case INSERT_PREPPED:
+      case UPSERT:
+      case UPSERT_PREPPED:
+      case BULK_INSERT:
+      case BULK_INSERT_PREPPED:
+      case INSERT_OVERWRITE:
+      case INSERT_OVERWRITE_TABLE:
+        setWriteTimer(table);
+        break;
+      case CLUSTER:
+        clusteringTimer = metrics.getClusteringCtx();
+        break;
+      case COMPACT:
+        compactionTimer = metrics.getCompactionCtx();
+        break;
+      default:
+    }
+
+    return table;
+  }
+
+  protected <R> R withLock(Supplier<R> s) {

Review comment:
       Good catch

##########
File path: hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/HoodieFlinkWriteClient.java
##########
@@ -397,11 +396,11 @@ public void completeCompaction(
   }
 
   @Override
-  protected HoodieTable<T, List<HoodieRecord<T>>, List<HoodieKey>, List<WriteStatus>> getTableAndInitCtx(WriteOperationType operationType, String instantTime) {
-    HoodieTableMetaClient metaClient = createMetaClient(true);
+  protected HoodieTable<T, List<HoodieRecord<T>>, List<HoodieKey>, List<WriteStatus>> doInitTable(HoodieTableMetaClient metaClient, Option<String> instantTime) {
     new UpgradeDowngrade(metaClient, config, context, FlinkUpgradeDowngradeHelper.getInstance())
-        .run(HoodieTableVersion.current(), instantTime);
-    return getTableAndInitCtx(metaClient, operationType);
+        .run(HoodieTableVersion.current(), instantTime.orElse(null));

Review comment:
       Good catch! Missed this one

##########
File path: hudi-client/hudi-java-client/src/main/java/org/apache/hudi/table/upgrade/JavaUpgradeDowngradeHelper.java
##########
@@ -0,0 +1,51 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.table.upgrade;
+
+import org.apache.hudi.common.engine.HoodieEngineContext;
+import org.apache.hudi.config.HoodieWriteConfig;
+import org.apache.hudi.keygen.constant.KeyGeneratorOptions;
+import org.apache.hudi.table.HoodieJavaTable;
+import org.apache.hudi.table.HoodieTable;
+
+/**
+ * Java upgrade and downgrade helper
+ */
+public class JavaUpgradeDowngradeHelper implements SupportsUpgradeDowngrade {

Review comment:
       Correct




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1056037774


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051369841


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1058894723


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059605309


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554",
       "triggerID" : "1059504479",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6556",
       "triggerID" : "1059572676",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6556) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059446848


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041222130


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r803152997



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       Chatted offline w/ @nsivabalan: 
   
   	- We can’t assume that MT update records will be ordered the same 
   	way as actual FS operations (these are not atomic)
   		- AI: MT record merging should be a commutative operation (not 
   		assuming the records ordering)
   			- This is possible for file-sizes
   			- This is not possible for deletes. However we’re assuming 
   			that the case of concurrent write and deletion of the same 
   			file is not possible
   				- This would only be possible with concurrent upset and 
   				rollback operation (affecting the same log-file), which 
   				is implausible, b/c either of have to be true:
   					- We’re appending to failed log-file (then the other 
   					writer is trying to rollback it concurrently, before 
   					it’s own write)
   					- Rollback (of completed instant) is running 
   					concurrently with append (meaning that restore is 
   					running concurrently with a write, which shouldn’t 
   					occur see below)
   	- Rollback should not be used to rollback completed instants (except 
   	in the Restore use-case)
   		- AI: We need to guard for that
   	- [HUDI-3407 ] Restore can NOT be run concurrently with any writes
   		- AI: We need to guard for that (for ex, we can take a look for the 
   		whole duration of the Restore) 

##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       Chatted offline w/ @nsivabalan: 
   
   	- We can’t assume that MT update records will be ordered the same 
   	way as actual FS operations (these are not atomic)
   		- AI: MT record merging should be a commutative operation (not 
   		assuming the records ordering)
   			- This is possible for file-sizes
   			- This is not possible for deletes. However we’re assuming 
   			that the case of concurrent write and deletion of the same 
   			file is not possible
   				- This would only be possible with concurrent upset and 
   				rollback operation (affecting the same log-file), which 
   				is implausible, b/c either of have to be true:
   					- We’re appending to failed log-file (then the other 
   					writer is trying to rollback it concurrently, before 
   					it’s own write)
   					- Rollback (of completed instant) is running 
   					concurrently with append (meaning that restore is 
   					running concurrently with a write, which shouldn’t 
   					occur see below)
   	- Rollback should not be used to rollback completed instants (except 
   	in the Restore use-case)
   		- AI: We need to guard for that
   	- [HUDI-3407] Restore can NOT be run concurrently with any writes
   		- AI: We need to guard for that (for ex, we can take a look for the 
   		whole duration of the Restore) 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r804078888



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       thanks a lot for capturing the gist. So, I assume you plan to fix the merge function to do max(old size, new size). 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802169067



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +375,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       Understood his point. My point was that this is not the right place for such assertions -- assertion instead placed in where the data originates (ie at the place where we construct MT record)




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1031954320


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737) 
   * 313096629734810eddb08b120dd0cb9841711434 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030391288


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1043921147


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042378872


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042564251


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042609195


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042361073


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042110266


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1029492492


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r798116440



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -215,19 +215,16 @@ public HoodieMetadataPayload preCombine(HoodieMetadataPayload previousRecord) {
 
     if (filesystemMetadata != null) {
       filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
+        if (fileInfo.getIsDeleted()) {
+          combinedFileInfo.remove(filename);
         } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
+          // NOTE: There are 2 possible cases here:
+          //    - New file is created: in that case we're simply adding its info
+          //    - File is appended to (only log-files of MOR tables on supported FS): in that case
+          //      we simply pick the info w/ largest file-size as the most recent one, since file's
+          //      sizes are increasing monotonically (meaning that the larger file-size is more recent one)
+          combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) ->

Review comment:
       Correct




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028571985


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   * 071c6180b5023f782da229552a6d3f63d1e4a67b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028432638


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r798098988



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -215,19 +215,16 @@ public HoodieMetadataPayload preCombine(HoodieMetadataPayload previousRecord) {
 
     if (filesystemMetadata != null) {
       filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
+        if (fileInfo.getIsDeleted()) {
+          combinedFileInfo.remove(filename);
         } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
+          // NOTE: There are 2 possible cases here:
+          //    - New file is created: in that case we're simply adding its info
+          //    - File is appended to (only log-files of MOR tables on supported FS): in that case
+          //      we simply pick the info w/ largest file-size as the most recent one, since file's
+          //      sizes are increasing monotonically (meaning that the larger file-size is more recent one)
+          combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) ->

Review comment:
       merge func takes care of adding an entry for the first time and hence remove L219 and 220 ? 

##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java
##########
@@ -87,40 +89,58 @@ public static void deleteMetadataTable(String basePath, HoodieEngineContext cont
    * @return a list of metadata table records
    */
   public static List<HoodieRecord> convertMetadataToRecords(HoodieCommitMetadata commitMetadata, String instantTime) {
-    List<HoodieRecord> records = new LinkedList<>();
-    List<String> allPartitions = new LinkedList<>();
-    commitMetadata.getPartitionToWriteStats().forEach((partitionStatName, writeStats) -> {
-      final String partition = partitionStatName.equals(EMPTY_PARTITION_NAME) ? NON_PARTITIONED_NAME : partitionStatName;
-      allPartitions.add(partition);
-
-      Map<String, Long> newFiles = new HashMap<>(writeStats.size());
-      writeStats.forEach(hoodieWriteStat -> {
-        String pathWithPartition = hoodieWriteStat.getPath();
-        if (pathWithPartition == null) {
-          // Empty partition
-          LOG.warn("Unable to find path in write stat to update metadata table " + hoodieWriteStat);
-          return;
-        }
-
-        int offset = partition.equals(NON_PARTITIONED_NAME) ? (pathWithPartition.startsWith("/") ? 1 : 0) : partition.length() + 1;
-        String filename = pathWithPartition.substring(offset);
-        long totalWriteBytes = newFiles.containsKey(filename)
-            ? newFiles.get(filename) + hoodieWriteStat.getTotalWriteBytes()
-            : hoodieWriteStat.getTotalWriteBytes();
-        newFiles.put(filename, totalWriteBytes);
-      });
-      // New files added to a partition
-      HoodieRecord record = HoodieMetadataPayload.createPartitionFilesRecord(
-          partition, Option.of(newFiles), Option.empty());
-      records.add(record);
-    });
+    List<HoodieRecord> records = new ArrayList<>(commitMetadata.getPartitionToWriteStats().size());
+
+    // Add record bearing partitions list
+    ArrayList<String> partitionsList = new ArrayList<>(commitMetadata.getPartitionToWriteStats().keySet());
+
+    records.add(HoodieMetadataPayload.createPartitionListRecord(partitionsList));
+
+    // New files added to a partition
+    List<HoodieRecord<HoodieMetadataPayload>> updatedFilesRecords =
+        commitMetadata.getPartitionToWriteStats().entrySet()
+            .stream()
+            .map(entry -> {
+              String partitionStatName = entry.getKey();
+              List<HoodieWriteStat> writeStats = entry.getValue();
+
+              String partition = partitionStatName.equals(EMPTY_PARTITION_NAME) ? NON_PARTITIONED_NAME : partitionStatName;
+
+              HashMap<String, Long> updatedFilesToSizesMapping =
+                  writeStats.stream().reduce(new HashMap<>(writeStats.size()),
+                      (map, stat) -> {
+                        String pathWithPartition = stat.getPath();
+                        if (pathWithPartition == null) {
+                          // Empty partition
+                          LOG.warn("Unable to find path in write stat to update metadata table " + stat);
+                          return map;
+                        }
+
+                        int offset = partition.equals(NON_PARTITIONED_NAME)
+                            ? (pathWithPartition.startsWith("/") ? 1 : 0)
+                            : partition.length() + 1;
+                        String filename = pathWithPartition.substring(offset);
+
+                        // Since write-stats are coming in no particular order, if the same
+                        // file have previously been appended to w/in the txn, we simply pick max
+                        // of the sizes as reported after every write, since file-sizes are
+                        // monotonically increasing (ie file-size never goes down, unless deleted)
+                        map.merge(filename, stat.getFileSizeInBytes(), Math::max);

Review comment:
       I am not sure if fileSizeInBytes will contain the entire file size. 
   Can you add some extra assertions to existing tests in TestHoodieLogFormat. we can be certain the fileSizeIbBytes always contain full file size. 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1029492492


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049299923


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049428471


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049438125


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   * 2790e24a229e808602113c7ed80932b09e56c8fd UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049487198


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1055078518


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054989518


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r799843295



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -368,22 +367,11 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     }
 
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
-      });
+      validatePayload(type, filesystemMetadata);
+      // Combine previous record w/ the new one
+      // NOTE: New records _always_ take precedence over the old one, as such no special case
+      //       handling is actually necessary
+      combinedFileInfo.putAll(filesystemMetadata);

Review comment:
       Scrap that comment, figured out what you're referring to




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1029565870


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1031954320


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737) 
   * 313096629734810eddb08b120dd0cb9841711434 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] prashantwason commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
prashantwason commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802058555



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -219,10 +220,22 @@ protected HoodieMetadataPayload(String key, int type,
                                                                                Option<Map<String, Long>> filesAdded,
                                                                                Option<List<String>> filesDeleted) {
     Map<String, HoodieMetadataFileInfo> fileInfo = new HashMap<>();
-    filesAdded.ifPresent(
-        m -> m.forEach((filename, size) -> fileInfo.put(filename, new HoodieMetadataFileInfo(size, false))));
-    filesDeleted.ifPresent(
-        m -> m.forEach(filename -> fileInfo.put(filename, new HoodieMetadataFileInfo(0L, true))));
+    filesAdded.ifPresent(filesMap ->
+        fileInfo.putAll(
+            filesMap.entrySet().stream().collect(

Review comment:
       minor: stream().collect() is going to double the memory used here as it creates a new map first before adding to fileInfo. I feel forEach is better suited here.
   
   Not a big issue as these are just filenames.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059378317


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059380467


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059380467


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042361073


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1055078518


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1029494165


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028486554


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049398381


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   * e1771f831ae0a59baf39497b337fe304be901149 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049393643


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049428471


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1058867584


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1056037774


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r818036625



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -1301,4 +1369,33 @@ public void close() {
     this.heartbeatClient.stop();
     this.txnManager.close();
   }
+
+  private void setWriteTimer(HoodieTable<T, I, K, O> table) {
+    String commitType = table.getMetaClient().getCommitActionType();
+    if (commitType.equals(HoodieTimeline.COMMIT_ACTION)) {
+      writeTimer = metrics.getCommitCtx();
+    } else if (commitType.equals(HoodieTimeline.DELTA_COMMIT_ACTION)) {
+      writeTimer = metrics.getDeltaCommitCtx();
+    }
+  }
+
+  private void tryUpgrade(HoodieTableMetaClient metaClient, Option<String> instantTime) {
+    UpgradeDowngrade upgradeDowngrade =
+        new UpgradeDowngrade(metaClient, config, context, upgradeDowngradeHelper);
+
+    if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {

Review comment:
       as per master, this code is available only in SparkEngine. Flink and java does not have this. Even if we wish to unify, I would do it in a separate patch and getting it reviewed by experts who have worked on it. Can you move this to SparkRDDWriteClient for now. 

##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -1246,17 +1243,88 @@ public HoodieMetrics getMetrics() {
   }
 
   /**
-   * Get HoodieTable and init {@link Timer.Context}.
+   * Instantiates engine-specific instance of {@link HoodieTable} as well as performs necessary
+   * bootstrapping operations (for ex, validating whether Metadata Table has to be bootstrapped)
    *
-   * @param operationType write operation type
+   * NOTE: THIS OPERATION IS EXECUTED UNDER LOCK, THEREFORE SHOULD AVOID ANY OPERATIONS
+   *       NOT REQUIRING EXTERNAL SYNCHRONIZATION
+   *
+   * @param metaClient instance of {@link HoodieTableMetaClient}
    * @param instantTime current inflight instant time
-   * @return HoodieTable
+   * @return instantiated {@link HoodieTable}
    */
-  protected abstract HoodieTable<T, I, K, O> getTableAndInitCtx(WriteOperationType operationType, String instantTime);
+  protected abstract HoodieTable<T, I, K, O> doInitTable(HoodieTableMetaClient metaClient, Option<String> instantTime);
 
   /**
-   * Sets write schema from last instant since deletes may not have schema set in the config.
+   * Instantiates and initializes instance of {@link HoodieTable}, performing crucial bootstrapping
+   * operations such as:
+   *
+   * NOTE: This method is engine-agnostic and SHOULD NOT be overloaded, please check on
+   * {@link #doInitTable(HoodieTableMetaClient, Option<String>)} instead
+   *
+   * <ul>
+   *   <li>Checking whether upgrade/downgrade is required</li>
+   *   <li>Bootstrapping Metadata Table (if required)</li>
+   *   <li>Initializing metrics contexts</li>
+   * </ul>
    */
+  protected final HoodieTable<T, I, K, O> initTable(WriteOperationType operationType, Option<String> instantTime) {
+    HoodieTableMetaClient metaClient = createMetaClient(true);
+    // Setup write schemas for deletes
+    if (operationType == WriteOperationType.DELETE) {
+      setWriteSchemaForDeletes(metaClient);
+    }
+
+    HoodieTable<T, I, K, O> table;
+
+    this.txnManager.beginTransaction();
+    try {
+      tryUpgrade(metaClient, instantTime);
+      table = doInitTable(metaClient, instantTime);
+    } finally {
+      this.txnManager.endTransaction();
+    }
+
+    // Validate table properties
+    metaClient.validateTableProperties(config.getProps(), operationType);
+    // Make sure that FS View is in sync
+    table.getHoodieView().sync();
+
+    switch (operationType) {
+      case INSERT:
+      case INSERT_PREPPED:
+      case UPSERT:
+      case UPSERT_PREPPED:
+      case BULK_INSERT:
+      case BULK_INSERT_PREPPED:
+      case INSERT_OVERWRITE:
+      case INSERT_OVERWRITE_TABLE:
+        setWriteTimer(table);
+        break;
+      case CLUSTER:
+        clusteringTimer = metrics.getClusteringCtx();
+        break;
+      case COMPACT:
+        compactionTimer = metrics.getCompactionCtx();
+        break;
+      default:
+    }
+
+    return table;
+  }
+
+  protected <R> R withLock(Supplier<R> s) {

Review comment:
       is this used anywhere ?

##########
File path: hudi-client/hudi-java-client/src/main/java/org/apache/hudi/table/upgrade/JavaUpgradeDowngradeHelper.java
##########
@@ -0,0 +1,51 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.hudi.table.upgrade;
+
+import org.apache.hudi.common.engine.HoodieEngineContext;
+import org.apache.hudi.config.HoodieWriteConfig;
+import org.apache.hudi.keygen.constant.KeyGeneratorOptions;
+import org.apache.hudi.table.HoodieJavaTable;
+import org.apache.hudi.table.HoodieTable;
+
+/**
+ * Java upgrade and downgrade helper
+ */
+public class JavaUpgradeDowngradeHelper implements SupportsUpgradeDowngrade {

Review comment:
       if I am not wrong, java did not have any upgrade/downgrade step prior to this patch and now we are adding it is it ?

##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -392,28 +405,53 @@ private HoodieMetadataColumnStats combineColumnStatsMetadata(HoodieMetadataPaylo
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) ->
+                // NOTE: We can’t assume that MT update records will be ordered the same way as actual
+                //       FS operations (since they are not atomic), therefore MT record merging should be a
+                //       _commutative_ & _associative_ operation (ie one that would work even in case records
+                //       will get re-ordered), which is
+                //          - Possible for file-sizes (since file-sizes will ever grow, we can simply
+                //          take max of the old and new records)
+                //          - Not possible for is-deleted flags*
+                //
+                //       *However, we’re assuming that the case of concurrent write and deletion of the same
+                //       file is _impossible_ -- it would only be possible with concurrent upsert and
+                //       rollback operation (affecting the same log-file), which is implausible, b/c either
+                //       of the following have to be true:
+                //          - We’re appending to failed log-file (then the other writer is trying to
+                //          rollback it concurrently, before it’s own write)
+                //          - Rollback (of completed instant) is running concurrently with append (meaning
+                //          that restore is running concurrently with a write, which is also nut supported

Review comment:
       thanks for the comments. definitely will be useful even for us down the line

##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -291,15 +302,15 @@ public void bootstrap(Option<Map<String, String>> extraMetadata) {
     if (config.getWriteConcurrencyMode().supportsOptimisticConcurrencyControl()) {
       throw new HoodieException("Cannot bootstrap the table in multi-writer mode");
     }
-    HoodieTable<T, I, K, O> table = getTableAndInitCtx(WriteOperationType.UPSERT, HoodieTimeline.METADATA_BOOTSTRAP_INSTANT_TS);
+    HoodieTable<T, I, K, O> table = initTable(WriteOperationType.UPSERT, Option.ofNullable(HoodieTimeline.METADATA_BOOTSTRAP_INSTANT_TS));
     rollbackFailedBootstrap();
     table.bootstrap(context, extraMetadata);
   }
 
   /**
    * Main API to rollback failed bootstrap.
    */
-  public void rollbackFailedBootstrap() {

Review comment:
       why moving it from public to protected? we can leave it as is. I don't think anyone outside might be having their own write client and implement these public methods. but curious on why changing it now ? 

##########
File path: hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/HoodieFlinkWriteClient.java
##########
@@ -397,11 +396,11 @@ public void completeCompaction(
   }
 
   @Override
-  protected HoodieTable<T, List<HoodieRecord<T>>, List<HoodieKey>, List<WriteStatus>> getTableAndInitCtx(WriteOperationType operationType, String instantTime) {
-    HoodieTableMetaClient metaClient = createMetaClient(true);
+  protected HoodieTable<T, List<HoodieRecord<T>>, List<HoodieKey>, List<WriteStatus>> doInitTable(HoodieTableMetaClient metaClient, Option<String> instantTime) {
     new UpgradeDowngrade(metaClient, config, context, FlinkUpgradeDowngradeHelper.getInstance())
-        .run(HoodieTableVersion.current(), instantTime);
-    return getTableAndInitCtx(metaClient, operationType);
+        .run(HoodieTableVersion.current(), instantTime.orElse(null));

Review comment:
       are we not calling upgrade downgrade twice? 
   once in TryUpgrade and once here within doInitTable ? 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059446848


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r820157190



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -1301,4 +1369,33 @@ public void close() {
     this.heartbeatClient.stop();
     this.txnManager.close();
   }
+
+  private void setWriteTimer(HoodieTable<T, I, K, O> table) {
+    String commitType = table.getMetaClient().getCommitActionType();
+    if (commitType.equals(HoodieTimeline.COMMIT_ACTION)) {
+      writeTimer = metrics.getCommitCtx();
+    } else if (commitType.equals(HoodieTimeline.DELTA_COMMIT_ACTION)) {
+      writeTimer = metrics.getDeltaCommitCtx();
+    }
+  }
+
+  private void tryUpgrade(HoodieTableMetaClient metaClient, Option<String> instantTime) {
+    UpgradeDowngrade upgradeDowngrade =
+        new UpgradeDowngrade(metaClient, config, context, upgradeDowngradeHelper);
+
+    if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {

Review comment:
       I am fine. but just that I want to get a stamp it from devs who work in flink and java. Just don't want to miss anything, bcoz, not many times every engine follows same logic. I checked the code and refactoring once again, seems to be fine. 
   @danny0405 : we are making some minor refactoring relating to upgradedowngrade invocation for flink engine. just wanted to keep you in the loop. 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042110266


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042564251


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042570800


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030427493


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1033228142


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0000",
       "status" : "CANCELED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * 0000 Unknown: [CANCELED](TBD) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030387036


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r799673205



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieCreateHandle.java
##########
@@ -235,19 +235,18 @@ protected void setupWriteStatus() throws IOException {
     stat.setPrevCommit(HoodieWriteStat.NULL_COMMIT);
     stat.setFileId(writeStatus.getFileId());
     stat.setPath(new Path(config.getBasePath()), path);
-    stat.setTotalWriteBytes(computeTotalWriteBytes());
-    stat.setFileSizeInBytes(computeFileSizeInBytes());
     stat.setTotalWriteErrors(writeStatus.getTotalErrorRecords());
+
+    long totalWrittenBytes = computeTotalWrittenBytes();
+    stat.setTotalWriteBytes(totalWrittenBytes);
+    stat.setFileSizeInBytes(totalWrittenBytes);
+
     RuntimeStats runtimeStats = new RuntimeStats();
     runtimeStats.setTotalCreateTime(timer.endTimer());
     stat.setRuntimeStats(runtimeStats);
   }
 
-  protected long computeTotalWriteBytes() throws IOException {
-    return FSUtils.getFileSize(fs, path);
-  }
-
-  protected long computeFileSizeInBytes() throws IOException {
+  protected long computeTotalWrittenBytes() throws IOException {

Review comment:
       Good point




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] prashantwason commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
prashantwason commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802061501



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +375,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over

Review comment:
       Good comment. Makes the logic very clear.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802061346



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -219,10 +220,22 @@ protected HoodieMetadataPayload(String key, int type,
                                                                                Option<Map<String, Long>> filesAdded,
                                                                                Option<List<String>> filesDeleted) {
     Map<String, HoodieMetadataFileInfo> fileInfo = new HashMap<>();
-    filesAdded.ifPresent(
-        m -> m.forEach((filename, size) -> fileInfo.put(filename, new HoodieMetadataFileInfo(size, false))));
-    filesDeleted.ifPresent(
-        m -> m.forEach(filename -> fileInfo.put(filename, new HoodieMetadataFileInfo(0L, true))));
+    filesAdded.ifPresent(filesMap ->
+        fileInfo.putAll(
+            filesMap.entrySet().stream().collect(
+                Collectors.toMap(Map.Entry::getKey, (entry) -> {
+                  long fileSize = entry.getValue();
+                  // Assert that the file-size of the file being added is positive, since Hudi
+                  // should not be creating empty files
+                  checkState(fileSize > 0);
+                  return new HoodieMetadataFileInfo(fileSize, false);
+                })))
+    );
+    filesDeleted.ifPresent(filesList ->
+        fileInfo.putAll(

Review comment:
       Agreed. Please check my previous comment regarding GC impact.
   
   Primary reason for this change to streamline the merge as much as possible, given that this code will be sitting in the hot-path 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041209468


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041939619


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1043877296


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   * f88dbd70b92b034ee357b02c9af16d1885a5462b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042570800


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1043877296


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   * f88dbd70b92b034ee357b02c9af16d1885a5462b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1058867584


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059550145


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554",
       "triggerID" : "1059504479",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059573896


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554",
       "triggerID" : "1059504479",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6556",
       "triggerID" : "1059572676",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6556) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1058894723


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049456121


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054991623


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051413537


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1056080250


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030387036


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036763831


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042609195


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802253573



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       I agree. but the scenario which you quoted are unlikely to happen in general.
   a. since cleaner will not touch latest file slice where regular writes go into (MOR table).
   b. incase of COW rollback, there is no log file concept and hence a rollback and a commit touching the same file is very unlikely. 
   So, two concurrent writes where one of them deletes while the other updates or adds a new file : I can't think of a valid scenario. may be there is, we need to think hard to see if we can come up w/ one.  
   
   But the scenario of rollback and concurrent updates to same file slice might happen in MOR table. 
   
   also, the fix that is being considered may not cause any regression and could possibly help thwart some of the scenarios. i.e taking the max file size rather than latest file size. Do you see any issues specifically to go w/ max of file sizes in merge function? Atleast for the rollback and regular writer in MOR use-case, we have to make the fix. I don't think we can ignore the use-case. 
   
   




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802157120



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +375,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       guess prashanth meant to check the oldFileInfo. the validate you are referring to validates the new incoming filesystemMetadata. 

##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       ok, let me take a stab to see if this is a valid scenario. this could be applicable only for hdfs.
   
   Let's say there is a concurrent write to a log file by two diff writers. one of them is doing a rollback and another is appending a log block. Let's say writer1 (who is doing a rollback) updates the log file first and gets size as 200 may be. And later writer2 appends to same log file and gets size as 300. Even though the order in which these writers appended to file could be writer1 followed by writer2. Its not guaranteed that the same order will be maintained when they reach metadata table. So, due to various reasons writer2 could complete its write earlier and could apply its changes to metadata first before writer1. 
   
   wouldn't we revert to a smaller size in this case when writer1 updates metadata table w/ 200 as size. 
   




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036897044


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049436871


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   * 2790e24a229e808602113c7ed80932b09e56c8fd UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049309417


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049299923


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049456121


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049398381


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   * e1771f831ae0a59baf39497b337fe304be901149 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049487198


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051495717


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054991623


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] prashantwason commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
prashantwason commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r799241584



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -368,22 +367,11 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     }
 
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
-      });
+      validatePayload(type, filesystemMetadata);
+      // Combine previous record w/ the new one
+      // NOTE: New records _always_ take precedence over the old one, as such no special case
+      //       handling is actually necessary
+      combinedFileInfo.putAll(filesystemMetadata);

Review comment:
       This does not take care of deletes. 
   
   If the filesystemMetadata has a delete, we want to remove it rather than adding a delete record into combinedFileInfo.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1029565870


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059504850


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554",
       "triggerID" : "1059504479",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1058959806


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059572676


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r820157441



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -1301,4 +1369,33 @@ public void close() {
     this.heartbeatClient.stop();
     this.txnManager.close();
   }
+
+  private void setWriteTimer(HoodieTable<T, I, K, O> table) {
+    String commitType = table.getMetaClient().getCommitActionType();
+    if (commitType.equals(HoodieTimeline.COMMIT_ACTION)) {
+      writeTimer = metrics.getCommitCtx();
+    } else if (commitType.equals(HoodieTimeline.DELTA_COMMIT_ACTION)) {
+      writeTimer = metrics.getDeltaCommitCtx();
+    }
+  }
+
+  private void tryUpgrade(HoodieTableMetaClient metaClient, Option<String> instantTime) {
+    UpgradeDowngrade upgradeDowngrade =
+        new UpgradeDowngrade(metaClient, config, context, upgradeDowngradeHelper);
+
+    if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {

Review comment:
       @yihua : we are making some minor refactoring relating to upgradedowngrade invocation for java engine. just wanted to keep you in the loop. Prior to this patch, we did not have any explicit upgrade downgrade. Just wanted to ensure unification does not cause any issues. if you can review it once and stamp it, would be nice.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028430746


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r798117376



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java
##########
@@ -87,40 +89,58 @@ public static void deleteMetadataTable(String basePath, HoodieEngineContext cont
    * @return a list of metadata table records
    */
   public static List<HoodieRecord> convertMetadataToRecords(HoodieCommitMetadata commitMetadata, String instantTime) {
-    List<HoodieRecord> records = new LinkedList<>();
-    List<String> allPartitions = new LinkedList<>();
-    commitMetadata.getPartitionToWriteStats().forEach((partitionStatName, writeStats) -> {
-      final String partition = partitionStatName.equals(EMPTY_PARTITION_NAME) ? NON_PARTITIONED_NAME : partitionStatName;
-      allPartitions.add(partition);
-
-      Map<String, Long> newFiles = new HashMap<>(writeStats.size());
-      writeStats.forEach(hoodieWriteStat -> {
-        String pathWithPartition = hoodieWriteStat.getPath();
-        if (pathWithPartition == null) {
-          // Empty partition
-          LOG.warn("Unable to find path in write stat to update metadata table " + hoodieWriteStat);
-          return;
-        }
-
-        int offset = partition.equals(NON_PARTITIONED_NAME) ? (pathWithPartition.startsWith("/") ? 1 : 0) : partition.length() + 1;
-        String filename = pathWithPartition.substring(offset);
-        long totalWriteBytes = newFiles.containsKey(filename)
-            ? newFiles.get(filename) + hoodieWriteStat.getTotalWriteBytes()
-            : hoodieWriteStat.getTotalWriteBytes();
-        newFiles.put(filename, totalWriteBytes);
-      });
-      // New files added to a partition
-      HoodieRecord record = HoodieMetadataPayload.createPartitionFilesRecord(
-          partition, Option.of(newFiles), Option.empty());
-      records.add(record);
-    });
+    List<HoodieRecord> records = new ArrayList<>(commitMetadata.getPartitionToWriteStats().size());
+
+    // Add record bearing partitions list
+    ArrayList<String> partitionsList = new ArrayList<>(commitMetadata.getPartitionToWriteStats().keySet());
+
+    records.add(HoodieMetadataPayload.createPartitionListRecord(partitionsList));
+
+    // New files added to a partition
+    List<HoodieRecord<HoodieMetadataPayload>> updatedFilesRecords =
+        commitMetadata.getPartitionToWriteStats().entrySet()
+            .stream()
+            .map(entry -> {
+              String partitionStatName = entry.getKey();
+              List<HoodieWriteStat> writeStats = entry.getValue();
+
+              String partition = partitionStatName.equals(EMPTY_PARTITION_NAME) ? NON_PARTITIONED_NAME : partitionStatName;
+
+              HashMap<String, Long> updatedFilesToSizesMapping =
+                  writeStats.stream().reduce(new HashMap<>(writeStats.size()),
+                      (map, stat) -> {
+                        String pathWithPartition = stat.getPath();
+                        if (pathWithPartition == null) {
+                          // Empty partition
+                          LOG.warn("Unable to find path in write stat to update metadata table " + stat);
+                          return map;
+                        }
+
+                        int offset = partition.equals(NON_PARTITIONED_NAME)
+                            ? (pathWithPartition.startsWith("/") ? 1 : 0)
+                            : partition.length() + 1;
+                        String filename = pathWithPartition.substring(offset);
+
+                        // Since write-stats are coming in no particular order, if the same
+                        // file have previously been appended to w/in the txn, we simply pick max
+                        // of the sizes as reported after every write, since file-sizes are
+                        // monotonically increasing (ie file-size never goes down, unless deleted)
+                        map.merge(filename, stat.getFileSizeInBytes(), Math::max);

Review comment:
       It does -- only case where we might provide something other than the file-size is `AppendHandle`, and it does set this to the full file size (it's a contract of this API)
   
   https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java#L417




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028486554


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028432638


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] prashantwason commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
prashantwason commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r799238795



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieCreateHandle.java
##########
@@ -235,19 +235,18 @@ protected void setupWriteStatus() throws IOException {
     stat.setPrevCommit(HoodieWriteStat.NULL_COMMIT);
     stat.setFileId(writeStatus.getFileId());
     stat.setPath(new Path(config.getBasePath()), path);
-    stat.setTotalWriteBytes(computeTotalWriteBytes());
-    stat.setFileSizeInBytes(computeFileSizeInBytes());
     stat.setTotalWriteErrors(writeStatus.getTotalErrorRecords());
+
+    long totalWrittenBytes = computeTotalWrittenBytes();
+    stat.setTotalWriteBytes(totalWrittenBytes);
+    stat.setFileSizeInBytes(totalWrittenBytes);
+
     RuntimeStats runtimeStats = new RuntimeStats();
     runtimeStats.setTotalCreateTime(timer.endTimer());
     stat.setRuntimeStats(runtimeStats);
   }
 
-  protected long computeTotalWriteBytes() throws IOException {
-    return FSUtils.getFileSize(fs, path);
-  }
-
-  protected long computeFileSizeInBytes() throws IOException {
+  protected long computeTotalWrittenBytes() throws IOException {

Review comment:
       computeFileSizeInBytes is a better name here and matches the FSUtils.getFileSize.
   
   It is an internal details that for CreateHandle the total written bytes will be equal to the file size. 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042378872


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042441606


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042493915


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041295531


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041994431


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041994431


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   * 4021121252e6c4a211cc29a0c425fb203712e9d9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1044049107


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r799670887



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -368,22 +367,11 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     }
 
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
-      });
+      validatePayload(type, filesystemMetadata);
+      // Combine previous record w/ the new one
+      // NOTE: New records _always_ take precedence over the old one, as such no special case
+      //       handling is actually necessary
+      combinedFileInfo.putAll(filesystemMetadata);

Review comment:
       @prashantwason can you please elaborate on why we want to have this behavior?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802067279



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +375,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       Actually moved that validation upstream to where we're building MT records to check that we never build the record of size <= 0




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r800214841



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       @prashantwason : aren't there any multi-writer scenarios, where a new commit could report a file w/ lower size compared to a previous commit. 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030391288


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1033327350


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051359116


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   * 2f65bc5fe37942aa72721f19a483194da02ba912 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049309417


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * f88dbd70b92b034ee357b02c9af16d1885a5462b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115) 
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051494793


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan merged pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #4739:
URL: https://github.com/apache/hudi/pull/4739


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1029494165


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028572870


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059378317


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1056080250


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1058959806


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 157095db0b8aa874ee72497e1ff00b108c84c2a9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036756231


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036763831


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036819845


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036819845


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036897044


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042440727


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054929428


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1056037292


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1032195047


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030389601


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] prashantwason commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
prashantwason commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802063659



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +375,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       Much better API usage than original verbose code. 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802061346



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -219,10 +220,22 @@ protected HoodieMetadataPayload(String key, int type,
                                                                                Option<Map<String, Long>> filesAdded,
                                                                                Option<List<String>> filesDeleted) {
     Map<String, HoodieMetadataFileInfo> fileInfo = new HashMap<>();
-    filesAdded.ifPresent(
-        m -> m.forEach((filename, size) -> fileInfo.put(filename, new HoodieMetadataFileInfo(size, false))));
-    filesDeleted.ifPresent(
-        m -> m.forEach(filename -> fileInfo.put(filename, new HoodieMetadataFileInfo(0L, true))));
+    filesAdded.ifPresent(filesMap ->
+        fileInfo.putAll(
+            filesMap.entrySet().stream().collect(
+                Collectors.toMap(Map.Entry::getKey, (entry) -> {
+                  long fileSize = entry.getValue();
+                  // Assert that the file-size of the file being added is positive, since Hudi
+                  // should not be creating empty files
+                  checkState(fileSize > 0);
+                  return new HoodieMetadataFileInfo(fileSize, false);
+                })))
+    );
+    filesDeleted.ifPresent(filesList ->
+        fileInfo.putAll(

Review comment:
       Agreed. Please check my previous comment regarding GC impact




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1033228142


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0000",
       "status" : "CANCELED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * 0000 Unknown: [CANCELED](TBD) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1032969168


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] prashantwason commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
prashantwason commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802064734



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +375,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       We can add a validation here that oldFileInfo should not have getIsDeleted()
   checkState(!oldFileInfo.getIsDeleted())




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] prashantwason commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
prashantwason commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802060072



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -219,10 +220,22 @@ protected HoodieMetadataPayload(String key, int type,
                                                                                Option<Map<String, Long>> filesAdded,
                                                                                Option<List<String>> filesDeleted) {
     Map<String, HoodieMetadataFileInfo> fileInfo = new HashMap<>();
-    filesAdded.ifPresent(
-        m -> m.forEach((filename, size) -> fileInfo.put(filename, new HoodieMetadataFileInfo(size, false))));
-    filesDeleted.ifPresent(
-        m -> m.forEach(filename -> fileInfo.put(filename, new HoodieMetadataFileInfo(0L, true))));
+    filesAdded.ifPresent(filesMap ->
+        fileInfo.putAll(
+            filesMap.entrySet().stream().collect(
+                Collectors.toMap(Map.Entry::getKey, (entry) -> {
+                  long fileSize = entry.getValue();
+                  // Assert that the file-size of the file being added is positive, since Hudi
+                  // should not be creating empty files
+                  checkState(fileSize > 0);
+                  return new HoodieMetadataFileInfo(fileSize, false);
+                })))
+    );
+    filesDeleted.ifPresent(filesList ->
+        fileInfo.putAll(

Review comment:
       minor: the forEach version is much simpler and clearer




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802059941



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -219,10 +220,22 @@ protected HoodieMetadataPayload(String key, int type,
                                                                                Option<Map<String, Long>> filesAdded,
                                                                                Option<List<String>> filesDeleted) {
     Map<String, HoodieMetadataFileInfo> fileInfo = new HashMap<>();
-    filesAdded.ifPresent(
-        m -> m.forEach((filename, size) -> fileInfo.put(filename, new HoodieMetadataFileInfo(size, false))));
-    filesDeleted.ifPresent(
-        m -> m.forEach(filename -> fileInfo.put(filename, new HoodieMetadataFileInfo(0L, true))));
+    filesAdded.ifPresent(filesMap ->
+        fileInfo.putAll(
+            filesMap.entrySet().stream().collect(

Review comment:
       I'd argue that this short-lived doubling is actually less impactful on GC than log(N) (where N is the number of filenames) resizes of the HashMap which is happening with individual `put`s




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1033226271


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "CANCELED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * 0000 Unknown: [CANCELED](TBD) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r800916255



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       @nsivabalan i don't think this is possible, since we never delete in-place from files.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036756231


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041209468


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041222130


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 6498d01bd48aeda771b67839b8968cf89492e139 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931) 
   * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042429647


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042429647


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028572870


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028430746


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028601646


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059573896


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554",
       "triggerID" : "1059504479",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6556",
       "triggerID" : "1059572676",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6556) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059550145


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554",
       "triggerID" : "1059504479",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059504479


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051495717


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051552922


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042441606


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049436871


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * ab452d91f4f39ddcfc816651d49f3ca56148ccd6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250) 
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   * 2790e24a229e808602113c7ed80932b09e56c8fd UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054989518


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054934439


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054989168


   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1051359116


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2790e24a229e808602113c7ed80932b09e56c8fd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255) 
   * 2f65bc5fe37942aa72721f19a483194da02ba912 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1054934439


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * 2f65bc5fe37942aa72721f19a483194da02ba912 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338) 
   * cb354756580e1a9b6515ff1c9cc670579a3e70f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1049438125


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * e1771f831ae0a59baf39497b337fe304be901149 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253) 
   * 2790e24a229e808602113c7ed80932b09e56c8fd UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1059504850


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c243f70d774b7ecb059dad4bb03870b2c2d4436b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5931",
       "triggerID" : "6498d01bd48aeda771b67839b8968cf89492e139",
       "triggerType" : "PUSH"
     }, {
       "hash" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6052",
       "triggerID" : "db249ffb501dc6a5b1b00ff698dc74196b37a5f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6063",
       "triggerID" : "4021121252e6c4a211cc29a0c425fb203712e9d9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6070",
       "triggerID" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6073",
       "triggerID" : "1042440727",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6082",
       "triggerID" : "ac98ca7624f74800ffbc801b3184f8b7c2d9368a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6115",
       "triggerID" : "f88dbd70b92b034ee357b02c9af16d1885a5462b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6250",
       "triggerID" : "ab452d91f4f39ddcfc816651d49f3ca56148ccd6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e1771f831ae0a59baf39497b337fe304be901149",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6253",
       "triggerID" : "e1771f831ae0a59baf39497b337fe304be901149",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6255",
       "triggerID" : "2790e24a229e808602113c7ed80932b09e56c8fd",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6333",
       "triggerID" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "triggerType" : "PUSH"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1051494793",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6419",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "2f65bc5fe37942aa72721f19a483194da02ba912",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6338",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6413",
       "triggerID" : "1054989168",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "cb354756580e1a9b6515ff1c9cc670579a3e70f4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6445",
       "triggerID" : "1056037292",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6532",
       "triggerID" : "157095db0b8aa874ee72497e1ff00b108c84c2a9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553",
       "triggerID" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b3136adef2a4ee6bad5d452b4fd762a3b12c9a59",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554",
       "triggerID" : "1059504479",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN
   * b3136adef2a4ee6bad5d452b4fd762a3b12c9a59 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6553) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6554) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r818165649



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -291,15 +302,15 @@ public void bootstrap(Option<Map<String, String>> extraMetadata) {
     if (config.getWriteConcurrencyMode().supportsOptimisticConcurrencyControl()) {
       throw new HoodieException("Cannot bootstrap the table in multi-writer mode");
     }
-    HoodieTable<T, I, K, O> table = getTableAndInitCtx(WriteOperationType.UPSERT, HoodieTimeline.METADATA_BOOTSTRAP_INSTANT_TS);
+    HoodieTable<T, I, K, O> table = initTable(WriteOperationType.UPSERT, Option.ofNullable(HoodieTimeline.METADATA_BOOTSTRAP_INSTANT_TS));
     rollbackFailedBootstrap();
     table.bootstrap(context, extraMetadata);
   }
 
   /**
    * Main API to rollback failed bootstrap.
    */
-  public void rollbackFailedBootstrap() {

Review comment:
       Client is publicly exposed component, we need to be extremely careful what we expose as public -- it essentially has a chance to become public API that we'll be on the hook for to maintain (semver-wise)




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r818165649



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -291,15 +302,15 @@ public void bootstrap(Option<Map<String, String>> extraMetadata) {
     if (config.getWriteConcurrencyMode().supportsOptimisticConcurrencyControl()) {
       throw new HoodieException("Cannot bootstrap the table in multi-writer mode");
     }
-    HoodieTable<T, I, K, O> table = getTableAndInitCtx(WriteOperationType.UPSERT, HoodieTimeline.METADATA_BOOTSTRAP_INSTANT_TS);
+    HoodieTable<T, I, K, O> table = initTable(WriteOperationType.UPSERT, Option.ofNullable(HoodieTimeline.METADATA_BOOTSTRAP_INSTANT_TS));
     rollbackFailedBootstrap();
     table.bootstrap(context, extraMetadata);
   }
 
   /**
    * Main API to rollback failed bootstrap.
    */
-  public void rollbackFailedBootstrap() {

Review comment:
       Client is publicly exposed API, we need to be extremely careful what we expose as public -- it essentially has a chance to become public API that we'll be on the hook for to maintain (semver-wise)




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r802159013



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       ok, let me take a stab to see if this is a valid scenario. this could be applicable only for hdfs.
   
   Let's say there is a concurrent write to a log file by two diff writers. one of them is doing a rollback and another is appending a log block. Let's say writer1 (who is doing a rollback) updates the log file first and gets size as 200 may be. And later writer2 appends to same log file and gets size as 300. Even though the order in which these writers appended to file could be writer1 followed by writer2. Its not guaranteed that the same order will be maintained when they reach metadata table. So, due to various reasons writer2 could complete its write earlier and could apply its changes to metadata first before writer1. 
   
   wouldn't the final resolved size from metadata be 200 in this case when both writers are done updating MDT? 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1033226271


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5737",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5781",
       "triggerID" : "313096629734810eddb08b120dd0cb9841711434",
       "triggerType" : "PUSH"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "CANCELED",
       "url" : "TBD",
       "triggerID" : "1032195047",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "313096629734810eddb08b120dd0cb9841711434",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5812",
       "triggerID" : "1032969168",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * 0000 Unknown: [CANCELED](TBD) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028601646


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 071c6180b5023f782da229552a6d3f63d1e4a67b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1030389601


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5697",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718",
       "triggerID" : "ea49cc74773deb96f8702d5454d927b80dc9f5a4",
       "triggerType" : "PUSH"
     }, {
       "hash" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "11f1b688459ab9017ebde2a38d1645e0f59b50c3",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ea49cc74773deb96f8702d5454d927b80dc9f5a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5718) 
   * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN
   * b24eaa1cd368d70d38010c96936ae5cb4ecdbfc7 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r800214756



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       don't we need to take the max of either of sizes? 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r803152997



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       Chatted offline w/ @nsivabalan: 
   
   	- We can’t assume that MT update records will be ordered the same 
   	way as actual FS operations (these are not atomic)
   		- AI: MT record merging should be a commutative operation (not 
   		assuming the records ordering)
   			- This is possible for file-sizes
   			- This is not possible for deletes. However we’re assuming 
   			that the case of concurrent write and deletion of the same 
   			file is not possible
   				- This would only be possible with concurrent upset and 
   				rollback operation (affecting the same log-file), which 
   				is implausible, b/c either of have to be true:
   					- We’re appending to failed log-file (then the other 
   					writer is trying to rollback it concurrently, before 
   					it’s own write)
   					- Rollback (of completed instant) is running 
   					concurrently with append (meaning that restore is 
   					running concurrently with a write, which shouldn’t 
   					occur see below)
   	- Rollback should not be used to rollback completed instants (except 
   	in the Restore use-case)
   		- AI: We need to guard for that
   	- Restore can NOT be run concurrently with any writes
   		- AI: We need to guard for that (for ex, we can take a look for the 
   		whole duration of the Restore) 




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#discussion_r803057873



##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java
##########
@@ -362,28 +361,33 @@ private HoodieMetadataColumnStats combineColumnStatsMetadatat(HoodieMetadataPayl
     return filesystemMetadata.entrySet().stream().filter(e -> e.getValue().getIsDeleted() == isDeleted);
   }
 
-  private Map<String, HoodieMetadataFileInfo> combineFilesystemMetadata(HoodieMetadataPayload previousRecord) {
+  private Map<String, HoodieMetadataFileInfo> combineFileSystemMetadata(HoodieMetadataPayload previousRecord) {
     Map<String, HoodieMetadataFileInfo> combinedFileInfo = new HashMap<>();
+
+    // First, add all files listed in the previous record
     if (previousRecord.filesystemMetadata != null) {
       combinedFileInfo.putAll(previousRecord.filesystemMetadata);
     }
 
+    // Second, merge in the files listed in the new record
     if (filesystemMetadata != null) {
-      filesystemMetadata.forEach((filename, fileInfo) -> {
-        // If the filename wasnt present then we carry it forward
-        if (!combinedFileInfo.containsKey(filename)) {
-          combinedFileInfo.put(filename, fileInfo);
-        } else {
-          if (fileInfo.getIsDeleted()) {
-            // file deletion
-            combinedFileInfo.remove(filename);
-          } else {
-            // file appends.
-            combinedFileInfo.merge(filename, fileInfo, (oldFileInfo, newFileInfo) -> {
-              return new HoodieMetadataFileInfo(oldFileInfo.getSize() + newFileInfo.getSize(), false);
-            });
-          }
-        }
+      validatePayload(type, filesystemMetadata);
+
+      filesystemMetadata.forEach((key, fileInfo) -> {
+        combinedFileInfo.merge(key, fileInfo,
+            // Combine previous record w/ the new one, new records taking precedence over
+            // the old one
+            //
+            // NOTE: That if previous listing contains the file that is being deleted by the tombstone
+            //       record (`IsDeleted` = true) in the new one, we simply delete the file from the resulting
+            //       listing as well as drop the tombstone itself.
+            //       However, if file is not present in the previous record we have to persist tombstone
+            //       record in the listing to make sure we carry forward information that this file
+            //       was deleted. This special case could occur since the merging flow is 2-stage:
+            //          - First we merge records from all of the delta log-files
+            //          - Then we merge records from base-files with the delta ones (coming as a result
+            //          of the previous step)
+            (oldFileInfo, newFileInfo) -> newFileInfo.getIsDeleted() ? null : newFileInfo);

Review comment:
       @nsivabalan we're not ignoring the use-case. My point was that FS changes and MT updates **have to** be atomic. Otherwise we can't guarantee MT consistency. They're atomic currently, so the use-case you've described is impossible.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4739:
URL: https://github.com/apache/hudi/pull/4739#issuecomment-1028571985


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691",
       "triggerID" : "5967651c87dc1a020e82a9a92de0f20ebeefb785",
       "triggerType" : "PUSH"
     }, {
       "hash" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "071c6180b5023f782da229552a6d3f63d1e4a67b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5967651c87dc1a020e82a9a92de0f20ebeefb785 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5691) 
   * 071c6180b5023f782da229552a6d3f63d1e4a67b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org