You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andrew MacKinlay (JIRA)" <ji...@apache.org> on 2017/01/16 05:02:26 UTC

[jira] [Updated] (SPARK-19234) AFTSurvivalRegression chokes silently or with confusing errors when any labels are zero

     [ https://issues.apache.org/jira/browse/SPARK-19234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew MacKinlay updated SPARK-19234:
-------------------------------------
    Attachment: spark-aft-failure.txt

Show failure case (a single zero-valued label, causing many errors and coefficients of zero) and success (replace 0 with 0.001 and everything works as expected)

> AFTSurvivalRegression chokes silently or with confusing errors when any labels are zero
> ---------------------------------------------------------------------------------------
>
>                 Key: SPARK-19234
>                 URL: https://issues.apache.org/jira/browse/SPARK-19234
>             Project: Spark
>          Issue Type: Bug
>          Components: ML
>    Affects Versions: 2.1.0
>         Environment: spark-shell or pyspark
>            Reporter: Andrew MacKinlay
>         Attachments: spark-aft-failure.txt
>
>
> If you try and use AFTSurvivalRegression and any label in your input data is 0.0, you get coefficients of 0.0 returned, and in many cases, errors like this:
> {{17/01/16 15:10:50 ERROR StrongWolfeLineSearch: Encountered bad values in function evaluation. Decreasing step size to NaN}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org