You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "xushiyan (via GitHub)" <gi...@apache.org> on 2023/04/20 14:11:46 UTC

[GitHub] [hudi] xushiyan opened a new pull request, #8517: [MINOR] Update colstats parallelism default to 200

xushiyan opened a new pull request, #8517:
URL: https://github.com/apache/hudi/pull/8517

   ### Change Logs
   
   Make colstats parallelism default to 200.
   
   ### Impact
   
   Improve perf when updating colstats for many new created files.
   
   ### Risk level
   
   Low.
   
   ### Documentation Update
   
   NA
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1516493998

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1517363197

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1528805834

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     }, {
       "hash" : "100ac5f5f9d8e9935625dda5419d5d66a92126a6",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16761",
       "triggerID" : "100ac5f5f9d8e9935625dda5419d5d66a92126a6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503) 
   * 100ac5f5f9d8e9935625dda5419d5d66a92126a6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16761) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1516477908

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1528804334

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     }, {
       "hash" : "100ac5f5f9d8e9935625dda5419d5d66a92126a6",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "100ac5f5f9d8e9935625dda5419d5d66a92126a6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503) 
   * 100ac5f5f9d8e9935625dda5419d5d66a92126a6 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xushiyan merged pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan merged PR #8517:
URL: https://github.com/apache/hudi/pull/8517


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1517877391

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1528828147

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     }, {
       "hash" : "100ac5f5f9d8e9935625dda5419d5d66a92126a6",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16761",
       "triggerID" : "100ac5f5f9d8e9935625dda5419d5d66a92126a6",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 100ac5f5f9d8e9935625dda5419d5d66a92126a6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16761) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1517187586

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16503) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8517: [MINOR] Update colstats parallelism default to 200

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8517:
URL: https://github.com/apache/hudi/pull/8517#issuecomment-1517354375

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "250a4dfe87b170e5df2ec282b9214e90f77fec45",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 250a4dfe87b170e5df2ec282b9214e90f77fec45 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org