[jira] [Closed] (MADLIB-1212) Incorrect step_size update in MLP

["Nikhil (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MADLIB-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nikhil closed MADLIB-1212.
--------------------------
    Resolution: Fixed

> Incorrect step_size update in MLP
> ---------------------------------
>
>                 Key: MADLIB-1212
>                 URL: https://issues.apache.org/jira/browse/MADLIB-1212
>             Project: Apache MADlib
>          Issue Type: Bug
>          Components: Module: Neural Networks
>            Reporter: Nandish Jayaram
>            Priority: Major
>             Fix For: v1.14
>
>
> The initialization and update of step_size based on the learning rate policy seems to be broken in MLP.
> {code}
> zero_indexed_iteration = current_iteration - 1
> if learning_rate_policy == "exp":
>     step_size = step_size_init * gamma**zero_indexed_iteration
> elif learning_rate_policy == "inv":
>     step_size = step_size_init * (current_iteration)**(-power)
> elif learning_rate_policy == "step":
>     step_size = step_size_init * gamma**(
>     math.floor(zero_indexed_iteration / iterations_per_step))
> {code}
>  The variable current_iteration in the above code snippet (from mlp_igd.py_in) does not seem to be updated in MLP, so the step_size will remain the same.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)