[jira] [Created] (MADLIB-1418) DL: performance improvements to fit transition function

["Nikhil Kak (Jira)" <ji...@apache.org>]

Nikhil Kak created MADLIB-1418:
----------------------------------

             Summary: DL: performance improvements to fit transition function
                 Key: MADLIB-1418
                 URL: https://issues.apache.org/jira/browse/MADLIB-1418
             Project: Apache MADlib
          Issue Type: Improvement
          Components: Deep Learning
            Reporter: Nikhil Kak
             Fix For: v1.17


 

{{We can speed up our per row/buffer time by not serializing the model weights as part of state except for the last row. For all rows except the last row, all we need from the model state is just the agg_image_count, so we can just set the state to agg_image_count for all rows except the last row. For the last row, the behavior remains the same as before}}

{{}}

{{With places10 20 msts gpdb6 (with 1 epoch for all msts), per iteration time went down from around 1700-1800 secs to 1600-1700 secs. }}

{{This will be more pronounced when training with a bigger dataset like places365/imagenet.}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)