You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "swapna267 (via GitHub)" <gi...@apache.org> on 2025/03/28 21:31:35 UTC
[PR] Flink: backport support create table like in flink catalog [iceberg]
swapna267 opened a new pull request, #12679:
URL: https://github.com/apache/iceberg/pull/12679
Backporting support create table like changes from Flink-1.20 to Flink-1.18/Flink-1.19.
https://github.com/apache/iceberg/pull/12199
High level changes:
Creation of dynamic Iceberg table in Flink Catalog using the underlying physical Iceberg table using LIKE clause.
Currently (without the changes in PR), create table in flink catalog works by configuring flink connector as described in,
[flink-connector](https://iceberg.apache.org/docs/nightly/flink-connector/#flink-connector)
But that needs user to provide the schema for the table. A way to tackle that is to do create table LIKE using below DDL.
CREATE TABLE table_wm (
eventTS AS CAST(t1 AS TIMESTAMP(3)),
WATERMARK FOR eventTS AS SOURCE_WATERMARK()
) WITH (
'connector'='iceberg',
'catalog-name'='iceberg_catalog',
'catalog-database'='testdb',
'catalog-table'='t'
) LIKE iceberg_catalog.testdb.t;
Options like connector, catalog-name, catalog-database, catalog-table need to be duplicated as Iceberg FlinkCatalog doesn't return any catalog related properties during getTable. This PR addresses the issue by including these properties when getTable is called , which will be used by Flink when creating table in Flink Catalog.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: backport support create table like in flink catalog [iceberg]
Posted by "swapna267 (via GitHub)" <gi...@apache.org>.
swapna267 commented on PR #12679:
URL: https://github.com/apache/iceberg/pull/12679#issuecomment-2764651406
@pvary this is clean backport. No changes compared to 1.20 PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: backport support create table like in flink catalog [iceberg]
Posted by "pvary (via GitHub)" <gi...@apache.org>.
pvary merged PR #12679:
URL: https://github.com/apache/iceberg/pull/12679
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: backport support create table like in flink catalog [iceberg]
Posted by "pvary (via GitHub)" <gi...@apache.org>.
pvary commented on PR #12679:
URL: https://github.com/apache/iceberg/pull/12679#issuecomment-2763227444
@swapna267: is this a clean backport, or you had to do changes compared to the 1.20 PR?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Flink: backport support create table like in flink catalog [iceberg]
Posted by "swapna267 (via GitHub)" <gi...@apache.org>.
swapna267 commented on PR #12679:
URL: https://github.com/apache/iceberg/pull/12679#issuecomment-2766798324
Thanks @pvary
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org