You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/11/25 23:54:35 UTC

[GitHub] [hudi] manojpec opened a new pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

manojpec opened a new pull request #4124:
URL: https://github.com/apache/hudi/pull/4124


   ## What is the purpose of the pull request
   
   Today table upgrade need is detected by the first write client after upgrade
   and if there is write concurrency mode configured it grabs the transaction
   lock to protect the table upgrade from other concurrent writers. However, the
   follow on metadata table creation and the initial bootstrapping also needs
   similar global protection to avoid race in inflight commits and the metadata
   table bootstrapping proces. Made the table upgrade and the follow-on metadata
   table creation and there by the initial bootstrapping process under the
   table level lock to avoid potential race with concurrent writers and other
   async table services.
   
   ## Brief change log
   
   *(for example:)*
     - *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
   
   ## Verify this pull request
   
   *(Please pick either of the following options)*
   
   This pull request is a trivial rework / code cleanup without any test coverage.
   
   *(or)*
   
   This pull request is already covered by existing tests, such as *(please describe tests)*.
   
   (or)
   
   This change added tests and can be verified as follows:
   
   *(example:)*
   
     - *Added integration tests for end-to-end.*
     - *Added HoodieClientWriteTest to verify the change.*
     - *Manually verified the change by running a job locally.*
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] manojpec commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
manojpec commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980478673


   @nsivabalan Have opened https://github.com/apache/hudi/pull/4134 in place of this to workaround rebase/merge issues


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980372212


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   * 0aed0f23bd15d3341d5419e7c792922da303d39b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980372212


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   * 0aed0f23bd15d3341d5419e7c792922da303d39b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980369006


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   * 0aed0f23bd15d3341d5419e7c792922da303d39b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980342986


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979877376


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [WIP] [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979576634


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980277921


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979576634


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [WIP] [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979814757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979522284


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980346532


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980346532


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980280957


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980455765


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3822",
       "triggerID" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * 0aed0f23bd15d3341d5419e7c792922da303d39b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979522284


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980280957


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] vinothchandar commented on a change in pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#discussion_r757624429



##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -438,33 +424,48 @@ private void writeTableMetadataForTableServices(HoodieTable<T, JavaRDD<HoodieRec
     UpgradeDowngrade upgradeDowngrade = new UpgradeDowngrade(
         metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance());
     if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {
-      if (config.getWriteConcurrencyMode().supportsOptimisticConcurrencyControl()) {
+      try {
+        // Lock the upgrade step and the follow-on metadata table creation
+        // and the initial bootstrapping so that concurrent writers if any
+        // are blocked from racing with these one time operations.
         this.txnManager.beginTransaction();
-        try {
-          // Ensure no inflight commits by setting EAGER policy and explicitly cleaning all failed commits
-          this.rollbackFailedWrites(getInstantsToRollback(metaClient, HoodieFailedWritesCleaningPolicy.EAGER, Option.of(instantTime)), true);
-          new UpgradeDowngrade(
-              metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance())
+        if (config.getWriteConcurrencyMode().supportsOptimisticConcurrencyControl()) {
+          // Ensure no in-flight commits by setting EAGER policy and explicitly cleaning all failed commits
+          this.rollbackFailedWrites(getInstantsToRollback(metaClient,
+              HoodieFailedWritesCleaningPolicy.EAGER, Option.of(instantTime)), true);
+          new UpgradeDowngrade(metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance())
               .run(HoodieTableVersion.current(), instantTime);
-        } finally {
-          this.txnManager.endTransaction();
+        } else {
+          upgradeDowngrade.run(HoodieTableVersion.current(), instantTime);
         }
-      } else {
-        upgradeDowngrade.run(HoodieTableVersion.current(), instantTime);
+        metaClient.reloadActiveTimeline();
+        initializeMetadataTable(Option.of(instantTime));

Review comment:
       this already takes care of my suggestion on the other one. 

##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -438,33 +424,48 @@ private void writeTableMetadataForTableServices(HoodieTable<T, JavaRDD<HoodieRec
     UpgradeDowngrade upgradeDowngrade = new UpgradeDowngrade(
         metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance());
     if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {

Review comment:
       lets move the check also into the lock? otherwise two writers would think they both need to upgrade and they just wait on the lock is all.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980429250


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3822",
       "triggerID" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   * 0aed0f23bd15d3341d5419e7c792922da303d39b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980362648


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980359375


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980342986


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980429250


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3822",
       "triggerID" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   * 0aed0f23bd15d3341d5419e7c792922da303d39b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] manojpec commented on pull request #4124: [WIP] [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
manojpec commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979812715


   @nsivabalan @vinothchandar :
   
   This PR is based off https://github.com/apache/hudi/pull/4114. The commit to review here is the last one only https://github.com/apache/hudi/pull/4124/commits/bd1b6ab01d300762c806693b300c996d5f9ffa0e


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979814757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980362648


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] manojpec commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
manojpec commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980496476


   This change is pulled into https://github.com/apache/hudi/pull/4114. Closing this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [WIP] [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979812959


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980369006


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     }, {
       "hash" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "0aed0f23bd15d3341d5419e7c792922da303d39b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3816) 
   * 0aed0f23bd15d3341d5419e7c792922da303d39b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980359375


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     }, {
       "hash" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "27c4ff2ffb00f6e1fb73081d52004007544faab0",
       "triggerType" : "PUSH"
     }, {
       "hash" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3e0ca308a88b536aaee9d9ad68205b96c682ef23",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ec2388b7ff6fa884c037cad5f8d117e9ddb625ef",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3812) 
   * 27c4ff2ffb00f6e1fb73081d52004007544faab0 UNKNOWN
   * 3e0ca308a88b536aaee9d9ad68205b96c682ef23 UNKNOWN
   * ec2388b7ff6fa884c037cad5f8d117e9ddb625ef UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] manojpec commented on a change in pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
manojpec commented on a change in pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#discussion_r757658750



##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -438,33 +424,48 @@ private void writeTableMetadataForTableServices(HoodieTable<T, JavaRDD<HoodieRec
     UpgradeDowngrade upgradeDowngrade = new UpgradeDowngrade(
         metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance());
     if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {

Review comment:
       fixed.

##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/SparkRDDWriteClient.java
##########
@@ -438,33 +424,48 @@ private void writeTableMetadataForTableServices(HoodieTable<T, JavaRDD<HoodieRec
     UpgradeDowngrade upgradeDowngrade = new UpgradeDowngrade(
         metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance());
     if (upgradeDowngrade.needsUpgradeOrDowngrade(HoodieTableVersion.current())) {
-      if (config.getWriteConcurrencyMode().supportsOptimisticConcurrencyControl()) {
+      try {
+        // Lock the upgrade step and the follow-on metadata table creation
+        // and the initial bootstrapping so that concurrent writers if any
+        // are blocked from racing with these one time operations.
         this.txnManager.beginTransaction();
-        try {
-          // Ensure no inflight commits by setting EAGER policy and explicitly cleaning all failed commits
-          this.rollbackFailedWrites(getInstantsToRollback(metaClient, HoodieFailedWritesCleaningPolicy.EAGER, Option.of(instantTime)), true);
-          new UpgradeDowngrade(
-              metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance())
+        if (config.getWriteConcurrencyMode().supportsOptimisticConcurrencyControl()) {
+          // Ensure no in-flight commits by setting EAGER policy and explicitly cleaning all failed commits
+          this.rollbackFailedWrites(getInstantsToRollback(metaClient,
+              HoodieFailedWritesCleaningPolicy.EAGER, Option.of(instantTime)), true);
+          new UpgradeDowngrade(metaClient, config, context, SparkUpgradeDowngradeHelper.getInstance())
               .run(HoodieTableVersion.current(), instantTime);
-        } finally {
-          this.txnManager.endTransaction();
+        } else {
+          upgradeDowngrade.run(HoodieTableVersion.current(), instantTime);
         }
-      } else {
-        upgradeDowngrade.run(HoodieTableVersion.current(), instantTime);
+        metaClient.reloadActiveTimeline();
+        initializeMetadataTable(Option.of(instantTime));

Review comment:
       right.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979877376


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-980277921


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "4be51b12bae384d6b28b96c146d569a8e99bb685",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3795) 
   * 4be51b12bae384d6b28b96c146d569a8e99bb685 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] manojpec closed pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
manojpec closed pull request #4124:
URL: https://github.com/apache/hudi/pull/4124


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979521844


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot commented on pull request #4124: [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979521844


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] hudi-bot removed a comment on pull request #4124: [WIP] [HUDI-2862] Table upgrade and metadata table bootstrap under the table lock

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4124:
URL: https://github.com/apache/hudi/pull/4124#issuecomment-979812959


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775",
       "triggerID" : "8f6c03bd44ca5256ec658f87ce6739d24e801901",
       "triggerType" : "PUSH"
     }, {
       "hash" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "bd1b6ab01d300762c806693b300c996d5f9ffa0e",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 8f6c03bd44ca5256ec658f87ce6739d24e801901 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3775) 
   * bd1b6ab01d300762c806693b300c996d5f9ffa0e UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org