You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "stevenzwu (via GitHub)" <gi...@apache.org> on 2025/07/23 18:25:56 UTC
[PR] Flink: fail file rewrite for V3 tables as row lineage not supported [iceberg]
stevenzwu opened a new pull request, #13646:
URL: https://github.com/apache/iceberg/pull/13646
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: fail file rewrite for V3 tables as row lineage not supported [iceberg]
Posted by "stevenzwu (via GitHub)" <gi...@apache.org>.
stevenzwu merged PR #13646:
URL: https://github.com/apache/iceberg/pull/13646
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: fail file rewrite for V3 tables as row lineage not supported [iceberg]
Posted by "amogh-jahagirdar (via GitHub)" <gi...@apache.org>.
amogh-jahagirdar commented on code in PR #13646:
URL: https://github.com/apache/iceberg/pull/13646#discussion_r2226357819
##########
flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/actions/RewriteDataFilesAction.java:
##########
@@ -38,6 +39,9 @@ public RewriteDataFilesAction(StreamExecutionEnvironment env, Table table) {
super(table);
this.env = env;
this.maxParallelism = env.getParallelism();
+ Preconditions.checkArgument(
+ !TableUtil.supportsRowLineage(table),
+ "Flink compaction does not support row lineage enabled tables: V3 and later");
Review Comment:
Nit: "Flink does not support compaction on row lineage enabled tables (V3+)"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: fail file rewrite for V3 tables as row lineage not supported [iceberg]
Posted by "pvary (via GitHub)" <gi...@apache.org>.
pvary commented on PR #13646:
URL: https://github.com/apache/iceberg/pull/13646#issuecomment-3112550491
CC: @Guosmilesmile, @mxm: It might worth to think about fixing this, and allowing Flink to work with V3 tables too
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: fail file rewrite for V3 tables as row lineage not supported [iceberg]
Posted by "Guosmilesmile (via GitHub)" <gi...@apache.org>.
Guosmilesmile commented on PR #13646:
URL: https://github.com/apache/iceberg/pull/13646#issuecomment-3112646968
@pvary Yes, we do need to fix this part. Perhaps we can draw some inspiration from how Spark handles it, but it still requires further thought.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org