[jira] [Created] (MADLIB-1310) Change the merge code to factor in the no of samples/images per buffer

["Nandish Jayaram (JIRA)" <ji...@apache.org>]

Nandish Jayaram created MADLIB-1310:
---------------------------------------

             Summary: Change the merge code to factor in the no of samples/images per buffer
                 Key: MADLIB-1310
                 URL: https://issues.apache.org/jira/browse/MADLIB-1310
             Project: Apache MADlib
          Issue Type: Bug
          Components: Deep Learning
            Reporter: Nandish Jayaram
             Fix For: v1.16


Based on the code in PR [https://github.com/apache/madlib/pull/355:]

Right now while merging the weights, accuracy and loss, we assume that all the buffers are of the same size. This may not be true. Ideally we should should use the total no of images per segment to average. This can be done by adding the no of images to the state and then use this during merge to average.
This can be done by replacing the `buffer_count` variable in state with `image_count`. 

Also investigate if there is a better way to pass SD other than the current logic i.e.
{code}
SD = kwargs['SD']
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)