You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "KnightChess (via GitHub)" <gi...@apache.org> on 2023/01/30 03:36:04 UTC

[GitHub] [hudi] KnightChess opened a new issue, #7788: [SUPPORT] Insert Overwrite Partition can not use bulk insert

KnightChess opened a new issue, #7788:
URL: https://github.com/apache/hudi/issues/7788

   **Describe the problem you faced**
   hi
   Excuse me,  why insert overwrite `partition table` can not use `bulk insert`(L144)? what problem will cause if support it？thanks
   
   https://github.com/apache/hudi/blob/88d8e5e96d5f5ee553b8405e32c79388e3ed3c09/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/ProvidesHoodieConfig.scala#L139-L161
   
   * Hudi version :
   master branch


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] KnightChess commented on issue #7788: [SUPPORT] Insert Overwrite Partition can not use bulk insert

Posted by "KnightChess (via GitHub)" <gi...@apache.org>.
KnightChess commented on issue #7788:
URL: https://github.com/apache/hudi/issues/7788#issuecomment-1419360957

   thanks, I will have a try


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on issue #7788: [SUPPORT] Insert Overwrite Partition can not use bulk insert

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #7788:
URL: https://github.com/apache/hudi/issues/7788#issuecomment-1418435270

   as of now, its not supported. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] KnightChess closed issue #7788: [SUPPORT] Insert Overwrite Partition can not use bulk insert

Posted by "KnightChess (via GitHub)" <gi...@apache.org>.
KnightChess closed issue #7788: [SUPPORT] Insert Overwrite Partition can not use bulk insert
URL: https://github.com/apache/hudi/issues/7788


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on issue #7788: [SUPPORT] Insert Overwrite Partition can not use bulk insert

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #7788:
URL: https://github.com/apache/hudi/issues/7788#issuecomment-1418435145

   Each is a different write operation and thats why. 
   
   on a high level, we have row writer code path and non-row writer code paths(GenericRecord/HoodieRecord). 
   bulk_insert is using row writer code path. except bulk_insert, every other operation is supported only in non-row writer code path. But we could take a stab and see if we can support insert_overwrite operations w/ bulk_insert code path. Needs some investigation/exploration. 
   I have created a jira https://issues.apache.org/jira/browse/HUDI-5705
   If you are interested, feel free to give it a try. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org