You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "JunchengMa (via GitHub)" <gi...@apache.org> on 2023/02/04 01:38:39 UTC

[GitHub] [iceberg] JunchengMa commented on issue #6741: Support write distribution mode as a Spark SqlConf option in Iceberg

JunchengMa commented on issue #6741:
URL: https://github.com/apache/iceberg/issues/6741#issuecomment-1416594916

   Thanks @dramaticlly for opening this feature request
   In addition to the GDPR deletion use case, the column redaction use case would also benefit from setting `write.update.distribution-mode`='none' at the job level to avoid shuffles.
   
   Example SQL:
   ```
   UPDATE db_name.tlb_name SET col_a = NULL WHERE date <= '20220801'
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org