You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Lehak Dharmani <le...@intellibridge.co> on 2018/08/02 12:46:28 UTC
Can we deploy python script on a spark cluster
We are trying to deploy python script on spark cluster . However as per
documentations , it is not possible to deploy python applications on a
cluster . Is there any alternative
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Can we deploy python script on a spark cluster
Posted by amit kumar singh <am...@gmail.com>.
Hi Lehak
You can make a scala project with oozing class
And one run class which will ship your python file to cluster
Define oozie coordinator with spark action or shell action
We are deploying pyspark based machine learning code
Sent from my iPhone
> On Aug 2, 2018, at 8:46 AM, Lehak Dharmani <le...@intellibridge.co> wrote:
>
>
> We are trying to deploy python script on spark cluster . However as per
> documentations , it is not possible to deploy python applications on a
> cluster . Is there any alternative
>
>
>
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org