You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "avineshsachan (via GitHub)" <gi...@apache.org> on 2025/08/27 07:24:07 UTC
[I] sort order(z-order) Support when calling rewrite file action from FLINK engine [iceberg]
avineshsachan opened a new issue, #13928:
URL: https://github.com/apache/iceberg/issues/13928
### Feature Request / Improvement
FLINK does not support Sort order(z-ordering) for iceberg Data , but Spark supports similar feature.
Requesting to add below feature request :
Sort order(z-ordering) for iceberg Data using rewrite file action from FLINK engine
### Query engine
Flink
### Willingness to contribute
- [ ] I can contribute this improvement/feature independently
- [ ] I would be willing to contribute this improvement/feature with guidance from the Iceberg community
- [x] I cannot contribute this improvement/feature at this time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] sort order(z-order) Support when calling rewrite file action from FLINK engine [iceberg]
Posted by "avineshsachan (via GitHub)" <gi...@apache.org>.
avineshsachan commented on issue #13928:
URL: https://github.com/apache/iceberg/issues/13928#issuecomment-3231762147
Spark supports sort_order using rewrite_data_files procedure as below:
Example :
CALL catalog_name.system.rewrite_data_files(table => 'db.sample', strategy => 'sort', sort_order => 'id DESC NULLS LAST,name ASC NULLS FIRST');
CALL catalog_name.system.rewrite_data_files(table => 'db.sample', strategy => 'sort', sort_order => 'zorder(c1,c2)');
More detail can be referred from : https://iceberg.apache.org/docs/latest/spark-procedures/#rewrite_data_files
========================sort_order feature from FLINK========================
FLINK also supports Rewrite files action but w/o sort_order feature.
Example :
import org.apache.iceberg.flink.actions.Actions;
TableLoader tableLoader = TableLoader.fromHadoopTable("hdfs://nn:8020/warehouse/path");
Table table = tableLoader.loadTable();
RewriteDataFilesActionResult result = Actions.forTable(table)
.rewriteDataFiles()
.execute();
More detail can be referred from : https://iceberg.apache.org/docs/latest/flink-actions/
One option to support sort_order feature from FLINK could be : either above Rewrite files action can be enhanced to support sort_order/zorder or new Action can also be developed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] sort order(z-order) Support when calling rewrite file action from FLINK engine [iceberg]
Posted by "pvary (via GitHub)" <gi...@apache.org>.
pvary commented on issue #13928:
URL: https://github.com/apache/iceberg/issues/13928#issuecomment-3285161414
I would recommend to use the implement this feature into the new TableMaintenance: https://iceberg.apache.org/docs/nightly/flink-maintenance/#flink-table-maintenance-streamingmode
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] sort order(z-order) Support when calling rewrite file action from FLINK engine [iceberg]
Posted by "JeonDaehong (via GitHub)" <gi...@apache.org>.
JeonDaehong commented on issue #13928:
URL: https://github.com/apache/iceberg/issues/13928#issuecomment-3227787381
@pvary @Guosmilesmile
I would like to try developing this feature myself. Could you please provide some guidance on how to get started?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] sort order(z-order) Support when calling rewrite file action from FLINK engine [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #13928: sort order(z-order) Support when calling rewrite file action from FLINK engine
URL: https://github.com/apache/iceberg/issues/13928
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] sort order(z-order) Support when calling rewrite file action from FLINK engine [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #13928:
URL: https://github.com/apache/iceberg/issues/13928#issuecomment-4043053612
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] sort order(z-order) Support when calling rewrite file action from FLINK engine [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #13928:
URL: https://github.com/apache/iceberg/issues/13928#issuecomment-4130716229
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org