You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2023/08/03 14:43:00 UTC

[jira] [Created] (FLINK-32745) Add a flag to skip InputSelectable preValidate step

Chesnay Schepler created FLINK-32745:
----------------------------------------

             Summary: Add a flag to skip InputSelectable preValidate step
                 Key: FLINK-32745
                 URL: https://issues.apache.org/jira/browse/FLINK-32745
             Project: Flink
          Issue Type: Improvement
          Components: API / DataStream, Runtime / Configuration
            Reporter: Chesnay Schepler
             Fix For: 1.19.0


{{StreamingJobGraphGenerator#preValidate}} has a step where it checks that no operator implements {{InputSelectable}} if checkpointing is enabled, because these features aren't compatible.

This step can be extremely expensive when the {{CodeGenOperatorFactory}} is used, because it requires all generated operator classes to actually be compiled (which usually only happens on the task manager).

If you know what jobs you're running this step can be pure overhead.
It would be nice if we'd have a flag to skip this validation step.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)