You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Anton Kalashnikov (Jira)" <ji...@apache.org> on 2021/08/25 17:20:00 UTC

[jira] [Created] (FLINK-23975) High checkpoint time for unaligned checkpoint when throthling in source

Anton Kalashnikov created FLINK-23975:
-----------------------------------------

             Summary: High checkpoint time for unaligned checkpoint when throthling in source
                 Key: FLINK-23975
                 URL: https://issues.apache.org/jira/browse/FLINK-23975
             Project: Flink
          Issue Type: Bug
            Reporter: Anton Kalashnikov


According to a brief test, if we add a delay in the source before emitting(outside of the checkpoint lock synchronization) it leads to increasing unaligned checkpoint time(in my case from 1sec to 15sec).

Approximate logic for throttling in source:

 

 
{noformat}
        @Override
        public void run(SourceContext<Type> sourceContext) throws Exception {
            while (running) {
                LockSupport.parkNanos(sleepNanos);

                synchronized (sourceContext.getCheckpointLock()) {
                    sourceContext.collect(new Type(ThreadLocalRandom.current().nextLong(), time, payload));
                }
            }
        }
{noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)