You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by zenglong chen <cz...@gmail.com> on 2019/07/25 11:15:55 UTC

spark config about spark.yarn.appMasterEnv

Hi all,
       Can spark set worker node environment like linux,eg:
                --conf
 spark.yarn.appMasterEnv.PYTHONPATH=./feature-server:$PYTHONPATH  ?
It is not working like linux shell.
I just want to add a path to PYTHONPATH on worker node rather than cover it.
Thanks for any answer!