You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "nsivabalan (via GitHub)" <gi...@apache.org> on 2024/02/14 01:52:42 UTC

[PR] [HUDI-7407] Making clean optional in standalone compaction and clustering job [hudi]

nsivabalan opened a new pull request, #10668:
URL: https://github.com/apache/hudi/pull/10668

   ### Change Logs
   
   Making clean optional in standalone compaction and clustering job
   
   ### Impact
   
   Support only triggering clustering or compaction w/ standalone spark jobs.
   
   ### Risk level (write none, low medium or high below)
   
   low
   
   ### Documentation Update
   
   _Describe any necessary documentation update if there is any new feature, config, or user-facing change_
   
   - _The config description must be updated if new configs are added or the default value of the configs are changed_
   - _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
     ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
     changes to the website._
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2139516375

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111",
       "triggerID" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "5a6c7723f716d5719a8011150f73077ab1ba3a1f",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24145",
       "triggerID" : "5a6c7723f716d5719a8011150f73077ab1ba3a1f",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111) 
   * 5a6c7723f716d5719a8011150f73077ab1ba3a1f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24145) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "codope (via GitHub)" <gi...@apache.org>.
codope commented on code in PR #10668:
URL: https://github.com/apache/hudi/pull/10668#discussion_r1618485348


##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieClusteringJob.java:
##########
@@ -92,6 +92,8 @@ public static class Config implements Serializable {
     public String sparkMemory = null;
     @Parameter(names = {"--retry", "-rt"}, description = "number of retries")
     public int retry = 0;
+    @Parameter(names = {"--skip-clean", "-sc"}, description = "do not trigger clean after compaction", required = false)
+    public Boolean skipClean = true;

Review Comment:
   should default be false to conform to existing behavior?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2095357015

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6e054ff5a4005e039b7af656993758882db0ec21 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439) 
   * 4efbcf64fa7e047112c8cb3e64d106d804e39d92 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2136577547

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111",
       "triggerID" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797) 
   * b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering job [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-1942975765

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6e054ff5a4005e039b7af656993758882db0ec21 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2095345534

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6e054ff5a4005e039b7af656993758882db0ec21 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439) 
   * 4efbcf64fa7e047112c8cb3e64d106d804e39d92 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2103415416

   not really a blocker as such. we can punt this if we are strapped for time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "codope (via GitHub)" <gi...@apache.org>.
codope commented on code in PR #10668:
URL: https://github.com/apache/hudi/pull/10668#discussion_r1620652100


##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieClusteringJob.java:
##########
@@ -92,6 +92,8 @@ public static class Config implements Serializable {
     public String sparkMemory = null;
     @Parameter(names = {"--retry", "-rt"}, description = "number of retries")
     public int retry = 0;
+    @Parameter(names = {"--skip-clean", "-sc"}, description = "do not trigger clean after compaction", required = false)
+    public Boolean skipClean = true;

Review Comment:
   not changing.. should be fine as it's an offline job.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering job [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-1943005533

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6e054ff5a4005e039b7af656993758882db0ec21 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering job [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-1943081578

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6e054ff5a4005e039b7af656993758882db0ec21 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2136568814

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797) 
   * b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2136556906

   @codope : ready to review. fixed the test failure. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2103290406

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2139636243

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111",
       "triggerID" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "5a6c7723f716d5719a8011150f73077ab1ba3a1f",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24145",
       "triggerID" : "5a6c7723f716d5719a8011150f73077ab1ba3a1f",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5a6c7723f716d5719a8011150f73077ab1ba3a1f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24145) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2136678726

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111",
       "triggerID" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2095424769

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4efbcf64fa7e047112c8cb3e64d106d804e39d92 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2103228251

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4efbcf64fa7e047112c8cb3e64d106d804e39d92 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685) 
   * 1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2103217040

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 4efbcf64fa7e047112c8cb3e64d106d804e39d92 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685) 
   * 1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10668:
URL: https://github.com/apache/hudi/pull/10668#issuecomment-2139501982

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22439",
       "triggerID" : "6e054ff5a4005e039b7af656993758882db0ec21",
       "triggerType" : "PUSH"
     }, {
       "hash" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23685",
       "triggerID" : "4efbcf64fa7e047112c8cb3e64d106d804e39d92",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23797",
       "triggerID" : "1b2ecc10deaab20be3ff90ccf2e4510a6d2e1d41",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111",
       "triggerID" : "b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "5a6c7723f716d5719a8011150f73077ab1ba3a1f",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "5a6c7723f716d5719a8011150f73077ab1ba3a1f",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b24eafcc00d5cf4a27ae7f9d7e70b1bfc5a12b1a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24111) 
   * 5a6c7723f716d5719a8011150f73077ab1ba3a1f UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [HUDI-7407] Making clean optional in standalone compaction and clustering jobs [hudi]

Posted by "codope (via GitHub)" <gi...@apache.org>.
codope merged PR #10668:
URL: https://github.com/apache/hudi/pull/10668


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org