You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2023/03/08 12:49:08 UTC

[GitHub] [hudi] xuzifu666 opened a new issue, #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and this is not reasonable in reality

xuzifu666 opened a new issue, #8131:
URL: https://github.com/apache/hudi/issues/8131

   **_Tips before filing an issue_**
   
   - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
   
   - Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
   
   - If you have triaged this as a bug, then file an [issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
   
   **Describe the problem you faced**
       spark.sql(
         s"""
            |merge into hudi_cow_pt_tbl as target
            |using (
            |	select id, name, data, country, ts from inc_table
            |) source
            |on source.id = target.id
            |when matched and source.data > target.data then
            |update set target.data = source.data, target.ts = source.ts
            |when matched and source.data = 12 then
            |update set target.data = source.data, target.ts = source.ts
            |when not matched then
            |insert *
            |""".stripMargin)
   
   when we execute sparksql as above，would report “Only one updating action is supported in MERGE INTO statement ”， but in actual，we need the more than one update action，the factor block many business for a long time
   
   A clear and concise description of the problem.
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1.
   2.
   3.
   4.
   
   **Expected behavior**
   
   A clear and concise description of what you expected to happen.
   
   **Environment Description**
   
   * Hudi version :
   
   * Spark version :
   
   * Hive version :
   
   * Hadoop version :
   
   * Storage (HDFS/S3/GCS..) :
   
   * Running on Docker? (yes/no) :
   
   
   **Additional context**
   
   Add any other context about the problem here.
   
   **Stacktrace**
   
   ```Add the stacktrace of the error.```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xuzifu666 commented on issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and this is not reasonable in reality

Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on issue #8131:
URL: https://github.com/apache/hudi/issues/8131#issuecomment-1460111768

   @XuQianJin-Stars 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and can not use function in actions

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8131:
URL: https://github.com/apache/hudi/issues/8131#issuecomment-1477374635

   Thanks for the double check @ad1happy2go , we are good to close the issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 closed issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and can not use function in actions

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 closed issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and can not use function in actions
URL: https://github.com/apache/hudi/issues/8131


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xuzifu666 commented on issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and this is not reasonable in reality

Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on issue #8131:
URL: https://github.com/apache/hudi/issues/8131#issuecomment-1460111114

   @xushiyan @danny0405 i though manay other user may have the problem，whether we have a plan to improvemnt it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and can not use function in actions

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8131:
URL: https://github.com/apache/hudi/issues/8131#issuecomment-1461390930

   The problem still exists in master?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xuzifu666 commented on issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and can not use function in actions

Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on issue #8131:
URL: https://github.com/apache/hudi/issues/8131#issuecomment-1460141964

   @alexeykudinkin can we remove checkUpdatingActions to implement the problem?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] ad1happy2go commented on issue #8131: [SUPPORT] Only one updating action is supported in MERGE INTO statement，and can not use function in actions

Posted by "ad1happy2go (via GitHub)" <gi...@apache.org>.
ad1happy2go commented on issue #8131:
URL: https://github.com/apache/hudi/issues/8131#issuecomment-1475735361

   @xuzifu666 @danny0405
   
   Able to reproduce this error with Hudi 0.13.0.
   
   Issue doesn't exist any more in master code. The same code snippet working with master code. 
   
   It got fixed with this commit - https://github.com/apache/hudi/commit/6589ebe84865b4e5e3b90b6629aa477816a81a48
   
   So closing this issue.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org