You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2023/03/13 18:28:41 UTC

[GitHub] [hudi] yihua opened a new pull request, #8171: [HUDI-5926] Improve cleaner parallelism

yihua opened a new pull request, #8171:
URL: https://github.com/apache/hudi/pull/8171

   ### Change Logs
   
   This PR fixes the cleaner execution to be parallelized at the file level instead of the partition level according to the documentation.
   
   ### Impact
   
   Improves the parallelism of cleaner execution.
   
   ### Risk level
   
   none
   
   ### Documentation Update
   
   The description of the `hoodie.cleaner.parallelism` config is updated.
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8171: [HUDI-5926] Improve cleaner parallelism

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8171:
URL: https://github.com/apache/hudi/pull/8171#issuecomment-1466715369

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 90d6399ae140f157972f46f2901366f79ed4b1bc UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua merged pull request #8171: [HUDI-5926] Improve cleaner parallelism

Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua merged PR #8171:
URL: https://github.com/apache/hudi/pull/8171


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8171: [HUDI-5926] Improve cleaner parallelism

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8171:
URL: https://github.com/apache/hudi/pull/8171#issuecomment-1467111032

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b6d4e1a92d727aadb765ef0e35d037786f8a7b4",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15696",
       "triggerID" : "9b6d4e1a92d727aadb765ef0e35d037786f8a7b4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 90d6399ae140f157972f46f2901366f79ed4b1bc UNKNOWN
   * 9b6d4e1a92d727aadb765ef0e35d037786f8a7b4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15696) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8171: [HUDI-5926] Improve cleaner parallelism

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8171:
URL: https://github.com/apache/hudi/pull/8171#issuecomment-1466816788

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b6d4e1a92d727aadb765ef0e35d037786f8a7b4",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15696",
       "triggerID" : "9b6d4e1a92d727aadb765ef0e35d037786f8a7b4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 90d6399ae140f157972f46f2901366f79ed4b1bc UNKNOWN
   * 9b6d4e1a92d727aadb765ef0e35d037786f8a7b4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15696) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8171: [HUDI-5926] Improve cleaner parallelism

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8171:
URL: https://github.com/apache/hudi/pull/8171#issuecomment-1466738495

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "90d6399ae140f157972f46f2901366f79ed4b1bc",
       "triggerType" : "PUSH"
     }, {
       "hash" : "9b6d4e1a92d727aadb765ef0e35d037786f8a7b4",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "9b6d4e1a92d727aadb765ef0e35d037786f8a7b4",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 90d6399ae140f157972f46f2901366f79ed4b1bc UNKNOWN
   * 9b6d4e1a92d727aadb765ef0e35d037786f8a7b4 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org