You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2017/02/28 11:19:45 UTC

[jira] [Updated] (SPARK-19759) ALSModel.predict on Dataframes : potential optimization by not using blas

     [ https://issues.apache.org/jira/browse/SPARK-19759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-19759:
------------------------------
    Affects Version/s:     (was: 2.3.0)
                       2.1.1
             Priority: Minor  (was: Major)

> ALSModel.predict on Dataframes : potential optimization by not using blas 
> --------------------------------------------------------------------------
>
>                 Key: SPARK-19759
>                 URL: https://issues.apache.org/jira/browse/SPARK-19759
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML
>    Affects Versions: 2.1.1
>            Reporter: Sue Ann Hong
>            Priority: Minor
>
> In the DataFrame ALS prediction function, we use blas.sdot which may be slower due to the conversion to Arrays. We can try operating on Seqs or another data structure to see if avoiding the conversion makes the operation faster. Ref: https://github.com/apache/spark/pull/17090/files/707bc6b153a7f899fbf3fe2a5675cacba1f95711#diff-be65dd1d6adc53138156641b610fcada 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org