You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/12/07 01:29:56 UTC

[GitHub] [hudi] yihua opened a new pull request, #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

yihua opened a new pull request, #7396:
URL: https://github.com/apache/hudi/pull/7396

   ### Change Logs
   
   Before this change, the NONE sort mode for bulk insert does coalesce for the input records or rows based on the shuffle parallelism of bulk insert (`hoodie.bulkinsert.shuffle.parallelism`) to reduce the parallelism.  This could affect write latency if the cluster workers are not fully utilized due to reduced parallelism.
   
   This PR removes the coalesce within NONE sort mode for bulk insert to match the default parquet write behavior.
   
   ### Impact
   
   The removal of coalesce within NONE sort mode for bulk insert will reduce the write latency if the input parallelism is higher and the cluster workers are not fully utilized due to the lower shuffle parallelism of bulk insert.
   
   ### Risk level
   
   low
   
   ### Documentation Update
   
   [HUDI-5339](https://issues.apache.org/jira/browse/HUDI-5339) for updating docs regarding the behavior change in NONE sort mode for bulk insert.
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344803095

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b988fd1e9c8c60d6113c937cfb133d298709fa84 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591) 
   * 87f44b32e57b2a4c01a3a6d9f7fdb557544b6674 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1340383778

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afe1c94140d5bd82628e5ab8b718bb46f04ea93c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494) 
   * 6fe80da54655d8502b333d580647e02325bd9f46 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1340289957

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afe1c94140d5bd82628e5ab8b718bb46f04ea93c UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1340293564

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afe1c94140d5bd82628e5ab8b718bb46f04ea93c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua commented on a diff in pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
yihua commented on code in PR #7396:
URL: https://github.com/apache/hudi/pull/7396#discussion_r1044788375


##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/NonSortPartitioner.java:
##########
@@ -36,7 +36,7 @@
   @Override
   public JavaRDD<HoodieRecord<T>> repartitionRecords(JavaRDD<HoodieRecord<T>> records,
                                                      int outputSparkPartitions) {

Review Comment:
   Makes sense.  I updated the Javadocs.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1340635644

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6fe80da54655d8502b333d580647e02325bd9f46 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] Zouxxyy commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
Zouxxyy commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1341321308

   Can you have a review of this? https://github.com/apache/hudi/pull/7372, I think they are somewhat related. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344741423

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6fe80da54655d8502b333d580647e02325bd9f46 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500) 
   * b988fd1e9c8c60d6113c937cfb133d298709fa84 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344992994

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     }, {
       "hash" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598",
       "triggerID" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 637214cc6aa2656c983fb0e4fc0d358a4cad2415 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1345126531

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     }, {
       "hash" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598",
       "triggerID" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c5a9d2e5fa3e557b39cc1142189b7588cdd333e1",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13609",
       "triggerID" : "c5a9d2e5fa3e557b39cc1142189b7588cdd333e1",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 637214cc6aa2656c983fb0e4fc0d358a4cad2415 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598) 
   * c5a9d2e5fa3e557b39cc1142189b7588cdd333e1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13609) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344714459

   > @yihua we also need to
   > 
   > * Review other impls that actually use parallelism hint (like GlobalSortPartitioner) and makes sure that we use `max(config, input_parallelism)`
   
   I created a ticket for the follow-up: [HUDI-5360](https://issues.apache.org/jira/browse/HUDI-5360).  Regarding the `GlobalSortPartitioner` and some other partitioners, we do want to reduce the parallelism instead of maximizing/keeping the input parallelism for file sizing, so that larger files can be created.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1345116028

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     }, {
       "hash" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598",
       "triggerID" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c5a9d2e5fa3e557b39cc1142189b7588cdd333e1",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c5a9d2e5fa3e557b39cc1142189b7588cdd333e1",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 637214cc6aa2656c983fb0e4fc0d358a4cad2415 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598) 
   * c5a9d2e5fa3e557b39cc1142189b7588cdd333e1 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua merged pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
yihua merged PR #7396:
URL: https://github.com/apache/hudi/pull/7396


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344736305

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6fe80da54655d8502b333d580647e02325bd9f46 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500) 
   * b988fd1e9c8c60d6113c937cfb133d298709fa84 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344747556

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6fe80da54655d8502b333d580647e02325bd9f46 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500) 
   * b988fd1e9c8c60d6113c937cfb133d298709fa84 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591) 
   * 87f44b32e57b2a4c01a3a6d9f7fdb557544b6674 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344798105

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b988fd1e9c8c60d6113c937cfb133d298709fa84 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591) 
   * 87f44b32e57b2a4c01a3a6d9f7fdb557544b6674 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #7396:
URL: https://github.com/apache/hudi/pull/7396#discussion_r1041660364


##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/NonSortPartitioner.java:
##########
@@ -36,7 +36,7 @@
   @Override
   public JavaRDD<HoodieRecord<T>> repartitionRecords(JavaRDD<HoodieRecord<T>> records,
                                                      int outputSparkPartitions) {

Review Comment:
   Let's update the java-doc of the method in the interface and mention that this is just a hint and could be ignored by the impl (to make it clear for the user of the API)



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #7396:
URL: https://github.com/apache/hudi/pull/7396#discussion_r1044804504


##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/NonSortPartitioner.java:
##########
@@ -25,18 +25,37 @@
 import org.apache.spark.api.java.JavaRDD;
 
 /**
- * A built-in partitioner that only does coalesce for input records for bulk insert operation,
- * corresponding to the {@code BulkInsertSortMode.NONE} mode.
+ * A built-in partitioner that avoids expensive sorting for the input records for bulk insert
+ * operation, by doing either of the following:
+ * <p>
+ * - If respecting the outputSparkPartitions, only does coalesce for input records;
+ * <p>
+ * - Otherwise, returns input records as is.
+ * <p>
+ * Corresponds to the {@code BulkInsertSortMode.NONE} mode.
  *
  * @param <T> HoodieRecordPayload type
  */
 public class NonSortPartitioner<T extends HoodieRecordPayload>
     implements BulkInsertPartitioner<JavaRDD<HoodieRecord<T>>> {
 
+  private final boolean mustRespectNumOutputPartitions;

Review Comment:
   nit: how about `enforceNumOutputPartitions`?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344716127

   > @yihua @alexeykudinkin Can you have a review of this? [#7372 (comment)](https://github.com/apache/hudi/pull/7372#issuecomment-1341286652), I think they are somewhat related.
   
   Thanks for raising this.  I'll check the PR.
   
   > Moreover, bulk insert is also used in cluster, and its parallelism is determined by cluser output files in one group.
   
   Thanks for pointing this out.  Yes, I also noticed this.  I revised the PR so that the NONE sort mode can still respect the specified number of output partitions for clustering.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344865397

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     }, {
       "hash" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598",
       "triggerID" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 87f44b32e57b2a4c01a3a6d9f7fdb557544b6674 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592) 
   * 637214cc6aa2656c983fb0e4fc0d358a4cad2415 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13598) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1345045099

   CI passes before rebasing.  Affected tests also pass after rebasing.  I'll merge this PR once Github actions pass.
   <img width="1475" alt="Screen Shot 2022-12-09 at 19 20 04" src="https://user-images.githubusercontent.com/2497195/206827580-7406c4c5-a489-467e-bb2e-668fc803dc89.png">
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua commented on a diff in pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
yihua commented on code in PR #7396:
URL: https://github.com/apache/hudi/pull/7396#discussion_r1044810580


##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/NonSortPartitioner.java:
##########
@@ -25,18 +25,37 @@
 import org.apache.spark.api.java.JavaRDD;
 
 /**
- * A built-in partitioner that only does coalesce for input records for bulk insert operation,
- * corresponding to the {@code BulkInsertSortMode.NONE} mode.
+ * A built-in partitioner that avoids expensive sorting for the input records for bulk insert
+ * operation, by doing either of the following:
+ * <p>
+ * - If respecting the outputSparkPartitions, only does coalesce for input records;
+ * <p>
+ * - Otherwise, returns input records as is.
+ * <p>
+ * Corresponds to the {@code BulkInsertSortMode.NONE} mode.
  *
  * @param <T> HoodieRecordPayload type
  */
 public class NonSortPartitioner<T extends HoodieRecordPayload>
     implements BulkInsertPartitioner<JavaRDD<HoodieRecord<T>>> {
 
+  private final boolean mustRespectNumOutputPartitions;

Review Comment:
   Looks better.  Addressed.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1344861883

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591",
       "triggerID" : "b988fd1e9c8c60d6113c937cfb133d298709fa84",
       "triggerType" : "PUSH"
     }, {
       "hash" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592",
       "triggerID" : "87f44b32e57b2a4c01a3a6d9f7fdb557544b6674",
       "triggerType" : "PUSH"
     }, {
       "hash" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "637214cc6aa2656c983fb0e4fc0d358a4cad2415",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b988fd1e9c8c60d6113c937cfb133d298709fa84 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13591) 
   * 87f44b32e57b2a4c01a3a6d9f7fdb557544b6674 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13592) 
   * 637214cc6aa2656c983fb0e4fc0d358a4cad2415 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #7396: [HUDI-5338] Remove coalesce within NONE sort mode for bulk insert

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7396:
URL: https://github.com/apache/hudi/pull/7396#issuecomment-1340388250

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494",
       "triggerID" : "afe1c94140d5bd82628e5ab8b718bb46f04ea93c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500",
       "triggerID" : "6fe80da54655d8502b333d580647e02325bd9f46",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afe1c94140d5bd82628e5ab8b718bb46f04ea93c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13494) 
   * 6fe80da54655d8502b333d580647e02325bd9f46 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13500) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org