You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/01/05 14:43:54 UTC

[GitHub] [hudi] dongkelun opened a new pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

dongkelun opened a new pull request #4515:
URL: https://github.com/apache/hudi/pull/4515


   ## *Tips*
   - *Thank you very much for contributing to Apache Hudi.*
   - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
   
   ## What is the purpose of the pull request
   
   *(For example: This pull request adds quick-start document.)*
   
   ## Brief change log
   
   *(for example:)*
     - *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
   
   ## Verify this pull request
   
   *(Please pick either of the following options)*
   
   This pull request is a trivial rework / code cleanup without any test coverage.
   
   *(or)*
   
   This pull request is already covered by existing tests, such as *(please describe tests)*.
   
   (or)
   
   This change added tests and can be verified as follows:
   
   *(example:)*
   
     - *Added integration tests for end-to-end.*
     - *Added HoodieClientWriteTest to verify the change.*
     - *Manually verified the change by running a job locally.*
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] dongkelun edited a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
dongkelun edited a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009623456


   @nsivabalan @codope 
   I found a previous issuse:[HUDI-1739](https://issues.apache.org/jira/browse/HUDI-1739)  in 'MetadataConversionUtils. getRequestedReplaceMetadata ` is the same as this issuse
   
   [#2784](https://github.com/apache/hudi/pull/2784)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013686170


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013700484


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   * 1903717f194cc266dde9ff64fef2a5d59f42c517 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1007390563


   @codope : Can you review this PR. May be there could be some follow ups in other places where we do create similar empty replace commit instants. I


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005748341


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] dongkelun commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
dongkelun commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013686310


   > @dongkelun @nsivabalan @codope this PR has pivoted and it's mostly not about warn log any more. Can we file a different ticket tailored to this PR and link to it?
   
   I have created a new issue [HUDI-3252](https://issues.apache.org/jira/browse/HUDI-3252) and modified the PR link to it. Do you think this description is accurate?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013688139


   looks good to me. I have closed the previous ticket btw.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005757044


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005754286


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] dongkelun commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
dongkelun commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1006384615


   > @dongkelun the warn log comes from clustering planning. can you help clarify how would this change avoid the repeated warn logs?
   
   Hello, the reason for the warning is that the content of replaceCommitRequestedInstantinstant is empty,There are many places to call this method, such as `HoodieSparkTable.create`:
   
   ```scala
       if (refreshTimeline) {
         hoodieSparkTable.getHoodieView().sync();
       }
   ```
   There are also many places to call  `HoodieSparkTable.create`,Therefore, it is not easy to reduce the warning log. It is better to avoid this warning directly from the source.`INSERT_OVERWRITE`'s commitActionType is `REPLACE_COMMIT_ACTION`,It creates an empty `replaceCommitRequestedInstantinstant `  in the `startCommitWithTime` method,We can avoid this warning from the source by changing it to non empty
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005751321


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013713392


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5270",
       "triggerID" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 1903717f194cc266dde9ff64fef2a5d59f42c517 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5270) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013702300


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5270",
       "triggerID" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   * 1903717f194cc266dde9ff64fef2a5d59f42c517 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5270) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] dongkelun commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
dongkelun commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009623456


   @nsivabalan @codope 
   I found a previous issuse:[HUDI-1739](https://issues.apache.org/jira/browse/HUDI-1739)  in 'MetadataConversionUtils. getRequestedReplaceMetadata ` is the same as this issuse


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005845303


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005751321


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005815414


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] dongkelun commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
dongkelun commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009620926


   > @dongkelun Rather than introduce a behavior change, I would prefer to remove the warn log itself. Is there any reason we still want to keep it? Also, while you're at it, can you make the method `getRequestedReplaceMetadata` private? I don't see it being used anywhere other than the same class.
   
   OK, I have made the method `getRequestedReplaceMetadata` in classes `MetadataConversionUtils` and `ClusteringUtils ` private


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013691863


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005896164


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] dongkelun commented on a change in pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
dongkelun commented on a change in pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#discussion_r784521348



##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java
##########
@@ -156,6 +157,18 @@ public void createNewInstant(HoodieInstant instant) {
     createFileInMetaPath(instant.getFileName(), Option.empty(), false);
   }
 
+  public void createRequestedReplaceCommit(String instantTime, String actionType) {
+    try {
+      HoodieInstant instant = new HoodieInstant(State.REQUESTED, actionType, instantTime);
+      LOG.info("Creating a new instant " + instant);

Review comment:
       It's not necessary, just to be consistent with the previous method `createNewInstant`




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009605269


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   * e47f03caabfd7af8588cce120989e0370111ae62 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009643659


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009643659


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013691863


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013686170


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005754286


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1007390563


   @codope : Can you review this PR. May be there could be some follow ups in other places where we do create similar empty replace commit instants. I


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] codope commented on a change in pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#discussion_r784507846



##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java
##########
@@ -156,6 +157,18 @@ public void createNewInstant(HoodieInstant instant) {
     createFileInMetaPath(instant.getFileName(), Option.empty(), false);
   }
 
+  public void createRequestedReplaceCommit(String instantTime, String actionType) {
+    try {
+      HoodieInstant instant = new HoodieInstant(State.REQUESTED, actionType, instantTime);
+      LOG.info("Creating a new instant " + instant);

Review comment:
       Is this info log necessary?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013700043


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   * 1903717f194cc266dde9ff64fef2a5d59f42c517 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009350266


   https://github.com/apache/hudi/pull/4553
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009605269


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   * e47f03caabfd7af8588cce120989e0370111ae62 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005896164


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005815414


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005748341


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] xushiyan commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1006374242


   @dongkelun the warn log comes from clustering planning. can you help clarify how would this change avoid the repeated warn logs?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1012627126


   @xushiyan @codope : if you folks don't have any other comments, I can go ahead and land this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013700043


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   * 1903717f194cc266dde9ff64fef2a5d59f42c517 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan merged pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #4515:
URL: https://github.com/apache/hudi/pull/4515


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005757044


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1005845303


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909) 
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] dongkelun commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
dongkelun commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1006196195


   @xushiyan @nsivabalan hello, can you please take a review?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] xushiyan commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013351492


   @dongkelun @nsivabalan @codope this PR has pivoted and it's mostly not about warn log any more. Can we file a different ticket tailored to this PR and link to it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013700484


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   * 1903717f194cc266dde9ff64fef2a5d59f42c517 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3252] Avoid creating empty requestedReplaceCommit in the startCommit method

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1013702300


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     }, {
       "hash" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269",
       "triggerID" : "a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5270",
       "triggerID" : "1903717f194cc266dde9ff64fef2a5d59f42c517",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * a8ac7e395e4bc9cad1f5eb78c6e74f2fd05e92ba Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5269) 
   * 1903717f194cc266dde9ff64fef2a5d59f42c517 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5270) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009321892


   I would vote to remote the log.warn msg only(ClusteringUtils L 93)) using a diff patch which we can pull into 0.10.1. we can continue discussions in this patch as to whats the right fix is. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009620230


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4515: [HUDI-3158] Reduce warn logs in Spark SQL INSERT OVERWRITE

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4515:
URL: https://github.com/apache/hudi/pull/4515#issuecomment-1009620230


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4909",
       "triggerID" : "6dc84d0a1b3f5250fa19e70ecccb311676d7a1e6",
       "triggerType" : "PUSH"
     }, {
       "hash" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "88c372fa74626363b1611825aa2d62e7ff292677",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1a657de1aa76f54015a405357cfd65ca1244bb19",
       "triggerType" : "PUSH"
     }, {
       "hash" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910",
       "triggerID" : "08c493bdeb441e150177fdaf3cbc5e4bcfabc42a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089",
       "triggerID" : "e47f03caabfd7af8588cce120989e0370111ae62",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 88c372fa74626363b1611825aa2d62e7ff292677 UNKNOWN
   * 1a657de1aa76f54015a405357cfd65ca1244bb19 UNKNOWN
   * 08c493bdeb441e150177fdaf3cbc5e4bcfabc42a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4910) 
   * e47f03caabfd7af8588cce120989e0370111ae62 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5089) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org