[GitHub] [iceberg] rdblue commented on pull request #3461: Spark: Request distribution and ordering for writes

[GitBox <gi...@apache.org>]

rdblue commented on pull request #3461:
URL: https://github.com/apache/iceberg/pull/3461#issuecomment-1015600294


   @pan3793, this isn't supported by Spark in 3.1. Iceberg respects distribution and ordering for plans that are managed by Iceberg SQL extensions in 3.1 (like `MERGE INTO`) but this can't be done for normal `INSERT` commands before 3.2. I think we should focus on 3.2 and later for this kind of feature.
   
   That said, if you manage to get it working in SQL extensions, please open a PR and we can see whether it is something that should be merged. I suspect it would be difficult and ugly to do in 3.1, but I haven't actually tried.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org