You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zhu Zhu (Jira)" <ji...@apache.org> on 2020/03/12 03:59:00 UTC
[jira] [Updated] (FLINK-16560) StreamExecutionEnvironment
configuration is empty when building program via
PackagedProgramUtils#createJobGraph
[ https://issues.apache.org/jira/browse/FLINK-16560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhu Zhu updated FLINK-16560:
----------------------------
Description:
PackagedProgramUtils#createJobGraph(...) is used to generate JobGraph in k8s job mode.
The problem is that the configuration field of StreamExecutionEnvironment is a newly created one when building the job program. This is because StreamPlanEnvironment ctor will base on the no param version ctor of StreamExecutionEnvironment.
This may lead to an unexpected result when invoking StreamExecutionEnvironment#configure(...) which relies on the configuration. Many configurations in the flink conf file will not be respected, like pipeline.time-characteristic, pipeline.operator-chaining, execution.buffer-timeout, and state backend configs.
was:
PackagedProgramUtils#createJobGraph(...) is used to generate JobGraph in k8s job mode.
The problem is that the configuration field of StreamExecutionEnvironment is a newly created one when building the job program. This is because StreamPlanEnvironment ctor will base on the no param version ctor of StreamExecutionEnvironment.
This may lead to an unexpected result when invoking StreamExecutionEnvironment#configure(...) which relies on the configuration.
> StreamExecutionEnvironment configuration is empty when building program via PackagedProgramUtils#createJobGraph
> ---------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-16560
> URL: https://issues.apache.org/jira/browse/FLINK-16560
> Project: Flink
> Issue Type: Bug
> Components: Client / Job Submission
> Affects Versions: 1.10.0
> Reporter: Zhu Zhu
> Priority: Major
>
> PackagedProgramUtils#createJobGraph(...) is used to generate JobGraph in k8s job mode.
> The problem is that the configuration field of StreamExecutionEnvironment is a newly created one when building the job program. This is because StreamPlanEnvironment ctor will base on the no param version ctor of StreamExecutionEnvironment.
> This may lead to an unexpected result when invoking StreamExecutionEnvironment#configure(...) which relies on the configuration. Many configurations in the flink conf file will not be respected, like pipeline.time-characteristic, pipeline.operator-chaining, execution.buffer-timeout, and state backend configs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)