[jira] [Comment Edited] (FLINK-29479) Support whether using system PythonPath for PyFlink jobs

["jackylau (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-29479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17620058#comment-17620058 ] 

jackylau edited comment on FLINK-29479 at 10/19/22 7:30 AM:
------------------------------------------------------------

After researching spark, it does not rely on system environment variables. Through careful offline communication with [~hxb] , we reached an agreement to use this parameter to decide whether to retain system environment variables
{code:java}
// code placeholder
@Experimentalpublic static final ConfigOption<Boolean> PYTHON_SYSTEMENV_ENABLED =
ConfigOptions.key("python.systemenv.enabled ")
.booleanType()
.defaultValue(true)
.withDescription("Whether uses system env in python."); {code}


was (Author: jackylau):
After researching spark, it does not rely on system environment variables. Through careful offline communication with [~hxb] , we reached an agreement to use this parameter to decide whether to retain system environment variables
@Experimentalpublic static final ConfigOption<Boolean> PYTHON_SYSTEMENV_ENABLED =
        ConfigOptions.key("python.systemenv.enabled ")
                .booleanType()
                .defaultValue(true)
                .withDescription("Whether uses system env in python.");

> Support whether using system PythonPath for PyFlink jobs
> --------------------------------------------------------
>
>                 Key: FLINK-29479
>                 URL: https://issues.apache.org/jira/browse/FLINK-29479
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / Python
>            Reporter: jackylau
>            Priority: Major
>             Fix For: 1.17.0
>
>
> It exists PYTHONPATH env in system,like yarn/k8s images, it will cause conflict with users python depdendency sometimes. so i suggest add a config to do whether using system env of PYTHONPATH



--
This message was sent by Atlassian Jira
(v8.20.10#820010)