Questions regarding DDL and savepoints

[Kevin Kwon <fs...@gmail.com>]

I have a question regarding DDLs if they are considered operators and can
be savepointed

For example

CREATE TABLE mytable (
  id BIGINT,
  data STRING
  WATERMARK(...)
) with (
  connector = 'kafka'
)

If I create the table like above, save&exit and resume application, will
the application start from the save point (including Kafka offset)?

There's also an ongoing issue that was created by me if the operator names
can be specified when creating tables with DDLs
https://issues.apache.org/jira/browse/FLINK-20368

Re: Questions regarding DDL and savepoints

[Yun Tang <my...@live.com>]

Hi Kevin,

If you pass the savepoint path to resume application [1], the application would resume from last savepoint.
If you change the logic of your DDL and since no uid can be set from users, I am afraid not all state could be restored as you expected.


[1] https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/cli.html#restore-a-savepoint

Best
Yun Tang
________________________________
From: Kevin Kwon <fs...@gmail.com>
Sent: Thursday, December 3, 2020 8:31
To: user@flink.apache.org <us...@flink.apache.org>
Subject: Questions regarding DDL and savepoints

I have a question regarding DDLs if they are considered operators and can be savepointed

For example

CREATE TABLE mytable (
  id BIGINT,
  data STRING
  WATERMARK(...)
) with (
  connector = 'kafka'
)

If I create the table like above, save&exit and resume application, will the application start from the save point (including Kafka offset)?

There's also an ongoing issue that was created by me if the operator names can be specified when creating tables with DDLs
https://issues.apache.org/jira/browse/FLINK-20368