You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Riccardo Ferrari <fe...@gmail.com> on 2017/07/09 21:58:57 UTC

PySpark saving custom pipelines

Hi list,

I have developed some custom Transformer/Estimators in python around some
libraries (scipy), now I would love to persist them for reuse in a
streaming app.

I am currently aware of this:
https://issues.apache.org/jira/browse/SPARK-17025

However I would like to hear from experienced users how do they persist
their pipelines.

Thanks in advance