[jira] [Commented] (PIO-116) PySpark Support

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIO-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152071#comment-16152071 ] 

ASF GitHub Bot commented on PIO-116:
------------------------------------

Github user marevol commented on the issue:

    https://github.com/apache/incubator-predictionio/pull/427
  
    Thank you for checking it. Replaced with if-else.


> PySpark Support
> ---------------
>
>                 Key: PIO-116
>                 URL: https://issues.apache.org/jira/browse/PIO-116
>             Project: PredictionIO
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Shinsuke Sugaya
>            Assignee: Shinsuke Sugaya
>
> This provides PySpark support with minimum PIO changes.
> 1. Support pyspark on pio-shell
> 2. Add python files to use pyspark
> 3. Add --main-py-file option to "pio train" to submit .py file to spark
> Note that this provides only fixes for Spark 2.x.
> (because this fixes expect to use SparkML)
> Sample project is:
> https://github.com/jpioug/predictionio-template-iris
> (For prediction API, Scala code is used.)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)