You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "tivanli (JIRA)" <ji...@apache.org> on 2019/01/29 09:24:00 UTC
[jira] [Updated] (FLINK-11443) Recovering from save point error
after adding "sum (constant)"
[ https://issues.apache.org/jira/browse/FLINK-11443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
tivanli updated FLINK-11443:
----------------------------
Description:
h3. Resuming from savepoint error when I add a "sum (2)" column to flink sql .
{code:java}
org.apache.flink.util.StateMigrationException: State migration is currently not supported.
at org.apache.flink.util.StateMigrationException.notSupported(StateMigrationException.java:42)
at org.apache.flink.runtime.state.RegisteredKeyValueStateBackendMetaInfo.resolveKvStateCompatibility(RegisteredKeyValueStateBackendMetaInfo.java:212)
at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.tryRegisterKvStateInformation(RocksDBKeyedStateBackend.java:1336)
at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.createInternalState(RocksDBKeyedStateBackend.java:1391)
at org.apache.flink.runtime.state.KeyedStateFactory.createInternalState(KeyedStateFactory.java:47)
at org.apache.flink.runtime.state.ttl.TtlStateFactory.createStateAndWrapWithTtlIfEnabled(TtlStateFactory.java:63)
at org.apache.flink.runtime.state.AbstractKeyedStateBackend.getOrCreateKeyedState(AbstractKeyedStateBackend.java:238)
at org.apache.flink.streaming.api.operators.AbstractStreamOperator.getOrCreateKeyedState(AbstractStreamOperator.java:562)
at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.open(WindowOperator.java:240)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:424)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:290)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
at java.lang.Thread.run(Thread.java:748)
{code}
Originally running sql：
{code:java}
SELECT TUMBLE_START(rowtime, INTERVAL '1' minute) as dtEventTime,
word,
sum(frequency) as frequency
FROM test
GROUP BY word,
TUMBLE(rowtime, INTERVAL '1' minute)
{code}
Modify sql to increase sum function
{code:java}
SELECT TUMBLE_START(rowtime, INTERVAL '1' minute) as dtEventTime,
word,
sum(frequency) as frequency,
sum(2) as s2
FROM test
GROUP BY word,
TUMBLE(rowtime, INTERVAL '1' minute)
{code}
was:
h3. Resuming from savepoint error when I add a "sum (2)" column to flink sql .
{code:java}
org.apache.flink.util.StateMigrationException: State migration is currently not supported.
at org.apache.flink.util.StateMigrationException.notSupported(StateMigrationException.java:42)
at org.apache.flink.runtime.state.RegisteredKeyValueStateBackendMetaInfo.resolveKvStateCompatibility(RegisteredKeyValueStateBackendMetaInfo.java:212)
at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.tryRegisterKvStateInformation(RocksDBKeyedStateBackend.java:1336)
at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.createInternalState(RocksDBKeyedStateBackend.java:1391)
at org.apache.flink.runtime.state.KeyedStateFactory.createInternalState(KeyedStateFactory.java:47)
at org.apache.flink.runtime.state.ttl.TtlStateFactory.createStateAndWrapWithTtlIfEnabled(TtlStateFactory.java:63)
at org.apache.flink.runtime.state.AbstractKeyedStateBackend.getOrCreateKeyedState(AbstractKeyedStateBackend.java:238)
at org.apache.flink.streaming.api.operators.AbstractStreamOperator.getOrCreateKeyedState(AbstractStreamOperator.java:562)
at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.open(WindowOperator.java:240)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:424)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:290)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
at java.lang.Thread.run(Thread.java:748)
{code}
{code:java}
--old sql
SELECT TUMBLE_START(rowtime, INTERVAL '1' minute) as dtEventTime,
word,
sum(frequency) as frequency
FROM test
GROUP BY word,
TUMBLE(rowtime, INTERVAL '1' minute)
--------------------------------------------------------
--new sql
SELECT TUMBLE_START(rowtime, INTERVAL '1' minute) as dtEventTime,
word,
sum(frequency) as frequency,
sum(2) as s2
FROM test
GROUP BY word,
TUMBLE(rowtime, INTERVAL '1' minute)
{code}
> Recovering from save point error after adding "sum (constant)"
> ---------------------------------------------------------------
>
> Key: FLINK-11443
> URL: https://issues.apache.org/jira/browse/FLINK-11443
> Project: Flink
> Issue Type: Bug
> Components: Table API & SQL
> Affects Versions: 1.6.2, 1.6.3
> Reporter: tivanli
> Priority: Minor
>
> h3. Resuming from savepoint error when I add a "sum (2)" column to flink sql .
>
> {code:java}
> org.apache.flink.util.StateMigrationException: State migration is currently not supported.
> at org.apache.flink.util.StateMigrationException.notSupported(StateMigrationException.java:42)
> at org.apache.flink.runtime.state.RegisteredKeyValueStateBackendMetaInfo.resolveKvStateCompatibility(RegisteredKeyValueStateBackendMetaInfo.java:212)
> at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.tryRegisterKvStateInformation(RocksDBKeyedStateBackend.java:1336)
> at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.createInternalState(RocksDBKeyedStateBackend.java:1391)
> at org.apache.flink.runtime.state.KeyedStateFactory.createInternalState(KeyedStateFactory.java:47)
> at org.apache.flink.runtime.state.ttl.TtlStateFactory.createStateAndWrapWithTtlIfEnabled(TtlStateFactory.java:63)
> at org.apache.flink.runtime.state.AbstractKeyedStateBackend.getOrCreateKeyedState(AbstractKeyedStateBackend.java:238)
> at org.apache.flink.streaming.api.operators.AbstractStreamOperator.getOrCreateKeyedState(AbstractStreamOperator.java:562)
> at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.open(WindowOperator.java:240)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:424)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:290)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> Originally running sql：
> {code:java}
> SELECT TUMBLE_START(rowtime, INTERVAL '1' minute) as dtEventTime,
> word,
> sum(frequency) as frequency
> FROM test
> GROUP BY word,
> TUMBLE(rowtime, INTERVAL '1' minute)
> {code}
> Modify sql to increase sum function
> {code:java}
> SELECT TUMBLE_START(rowtime, INTERVAL '1' minute) as dtEventTime,
> word,
> sum(frequency) as frequency,
> sum(2) as s2
> FROM test
> GROUP BY word,
> TUMBLE(rowtime, INTERVAL '1' minute)
> {code}
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)