You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Anton Kalashnikov (Jira)" <ji...@apache.org> on 2021/08/25 17:20:00 UTC
[jira] [Created] (FLINK-23975) High checkpoint time for unaligned
checkpoint when throthling in source
Anton Kalashnikov created FLINK-23975:
-----------------------------------------
Summary: High checkpoint time for unaligned checkpoint when throthling in source
Key: FLINK-23975
URL: https://issues.apache.org/jira/browse/FLINK-23975
Project: Flink
Issue Type: Bug
Reporter: Anton Kalashnikov
According to a brief test, if we add a delay in the source before emitting(outside of the checkpoint lock synchronization) it leads to increasing unaligned checkpoint time(in my case from 1sec to 15sec).
Approximate logic for throttling in source:
{noformat}
@Override
public void run(SourceContext<Type> sourceContext) throws Exception {
while (running) {
LockSupport.parkNanos(sleepNanos);
synchronized (sourceContext.getCheckpointLock()) {
sourceContext.collect(new Type(ThreadLocalRandom.current().nextLong(), time, payload));
}
}
}
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)