You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/06 07:12:41 UTC

[GitHub] [hudi] xicm opened a new pull request, #6608: [HUDI-4752] Add dedup support for MOR table in cli

xicm opened a new pull request, #6608:
URL: https://github.com/apache/hudi/pull/6608

   ### Change Logs
   
   _Describe context and summary for this change. Highlight if any code was copied._
   
   ### Impact
   
   _Describe any public API or user-facing feature change or any performance impact._
   
   **Risk level: none | low | medium | high**
   
   _Choose one. If medium or high, explain what verification was done to mitigate the risks._
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1238119942

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 784c8986c6150016e1e53bf9bd1aab23aa2d991a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1237807670

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 784c8986c6150016e1e53bf9bd1aab23aa2d991a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1246376322

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218",
       "triggerID" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348",
       "triggerID" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 340548ebdb9d36734f1349fa91af3cc65bb4963a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218) 
   * 74ab4e17c851a4d7a910269b5e36e52880321ba8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1237801174

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1239065404

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218",
       "triggerID" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 784c8986c6150016e1e53bf9bd1aab23aa2d991a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182) 
   * 340548ebdb9d36734f1349fa91af3cc65bb4963a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1239722010

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218",
       "triggerID" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 340548ebdb9d36734f1349fa91af3cc65bb4963a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1246535685

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218",
       "triggerID" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348",
       "triggerID" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 74ab4e17c851a4d7a910269b5e36e52880321ba8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1244968702

   > Is it necessary to enhance ITTestRepairsCommand to support MOR?
   
   It's better to add a test to verify the dedup logic for MOR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1239000345

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 784c8986c6150016e1e53bf9bd1aab23aa2d991a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182) 
   * 340548ebdb9d36734f1349fa91af3cc65bb4963a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xicm commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
xicm commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1244977503

   > > Is it necessary to enhance ITTestRepairsCommand to support MOR?
   > 
   > It's better to add a test to verify the dedup logic for MOR.
   
   I've read this code of the test, and it would be nice if @beforeeach could support parameterized tests, but it doesn't currently,
   
   What I can think of is to write a common test class, and then MOR and COW extend the Common. Do you have any good idea?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1247170466

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348",
       "triggerID" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 74ab4e17c851a4d7a910269b5e36e52880321ba8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xicm commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
xicm commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1237787312

   Is it necessary to enhance ITTestRepairsCommand to support MOR?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1247164589

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 74ab4e17c851a4d7a910269b5e36e52880321ba8 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1247480389

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348",
       "triggerID" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 74ab4e17c851a4d7a910269b5e36e52880321ba8 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11348) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua merged pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
yihua merged PR #6608:
URL: https://github.com/apache/hudi/pull/6608


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xicm commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
xicm commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1244971635

   > LGTM. @xicm Have you tested that the Dedup job can deduplicate the records in a MOR table?
   
   I tested with MOR table on my local cluster.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1246308511

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218",
       "triggerID" : "340548ebdb9d36734f1349fa91af3cc65bb4963a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "74ab4e17c851a4d7a910269b5e36e52880321ba8",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 340548ebdb9d36734f1349fa91af3cc65bb4963a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11218) 
   * 74ab4e17c851a4d7a910269b5e36e52880321ba8 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1245993087

   @xicm one possible way is to generate two tables in beforeeach method, one COW and one MOR with different base paths.  Then you can parameterize the tests based on the base path.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6608: [HUDI-4752] Add dedup support for MOR table in cli

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6608:
URL: https://github.com/apache/hudi/pull/6608#issuecomment-1237813351

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "3ace8fd54f3aceec456b471e750c1aa1e04fa8f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182",
       "triggerID" : "784c8986c6150016e1e53bf9bd1aab23aa2d991a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 3ace8fd54f3aceec456b471e750c1aa1e04fa8f7 UNKNOWN
   * 784c8986c6150016e1e53bf9bd1aab23aa2d991a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11182) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org