You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Prabhu Joseph (Jira)" <ji...@apache.org> on 2022/12/02 10:56:00 UTC
[jira] [Created] (FLINK-30277) Allow PYTHONPATH of Python Worker to be configurable
Prabhu Joseph created FLINK-30277:
-------------------------------------
Summary: Allow PYTHONPATH of Python Worker to be configurable
Key: FLINK-30277
URL: https://issues.apache.org/jira/browse/FLINK-30277
Project: Flink
Issue Type: Improvement
Components: API / Python
Affects Versions: 1.16.0
Reporter: Prabhu Joseph
Currently, below are the ways Python Worker gets the Python Flink Dependencies.
# Worker Node's System Python Path (/usr/local/lib64/python3.7/site-packages)
# Client passes the python Dependencies through -pyfs and --pyarch which is localized into PYTHONPATH of Python Worker.
# Client passes the requirements through -pyreq which gets installed on Worker Node and added into PYTHONPATH of Python Worker.
This Jira intends to allow PYTHONPATH of Python Worker to be configurable where admin/Service provider can install the required python flink depencies on a custom path (/usr/lib/pyflink/lib/python3.7/site-packages) on all Worker Nodes and then set the path in the client machine configuration flink-conf.yaml. This way it works without any configurations from the Application Users and also without affecting any other components dependent on System Python Path.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)