You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Femi Anthony <fe...@gmail.com> on 2019/09/23 21:13:40 UTC

PySpark with custom transformer project organization

I have a Pyspark project that requires a custom ML Pipeline Transformer written in Scala. What is the best practice regarding project organization ? Should I include the scala files in the general Python project or should they be in a separate repo ? 

Opinions and suggestions welcome.

Sent from my iPhone
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org