[jira] [Resolved] (SPARK-5101) Add common ML math functions

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-5101.
------------------------------
       Resolution: Fixed
    Fix Version/s: 1.3.0

This was resolved a while ago:
https://github.com/apache/spark/commit/60e2d9e2902b132b14191c9791c71e8f0d42ce9d

> Add common ML math functions
> ----------------------------
>
>                 Key: SPARK-5101
>                 URL: https://issues.apache.org/jira/browse/SPARK-5101
>             Project: Spark
>          Issue Type: New Feature
>          Components: MLlib
>            Reporter: Xiangrui Meng
>            Assignee: DB Tsai
>            Priority: Minor
>             Fix For: 1.3.0
>
>
> We can add common ML math functions to MLlib. It may be a little tricky to implement those functions in a numerically stable way. For example,
> {code}
> math.log(1 + math.exp(x))
> {code}
> should be implemented as
> {code}
> if (x > 0) {
>   x + math.log1p(math.exp(-x))
> } else {
>   math.log1p(math.exp(x))
> }
> {code}
> It becomes hard to maintain if we have multiple copies of the correct implementation in the codebase. A good place for those functions could be `mllib.util.MathFunctions`.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org