You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Mike Dusenberry (JIRA)" <ji...@apache.org> on 2017/09/15 23:09:01 UTC

[jira] [Commented] (SYSTEMML-1819) Create Keras2DML: Keras frontend to SystemML

    [ https://issues.apache.org/jira/browse/SYSTEMML-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168659#comment-16168659 ] 

Mike Dusenberry commented on SYSTEMML-1819:
-------------------------------------------

[PR 662 | https://github.com/apache/systemml/pull/622] submitted by [~anoojp].

> Create Keras2DML: Keras frontend to SystemML
> --------------------------------------------
>
>                 Key: SYSTEMML-1819
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1819
>             Project: SystemML
>          Issue Type: New Feature
>            Reporter: Mike Dusenberry
>            Assignee: Anooj Patel
>          Time Spent: 1,200h
>  Remaining Estimate: 0h
>
> This task covers the creation of a "Keras2DML" frontend for SystemML, built upon the [Caffe2DML | http://apache.github.io/systemml/beginners-guide-caffe2dml] infrastructure, that will allow users to define (and even train) models in Keras and then import them into SystemML for distributed training and prediction.  As an initial set of thoughts, the input could be either (1) a Keras {{Model}} object, or (2) a saved Keras model hdf5 file, and the output of training could be either (1) a Keras {{Model}} object, (2) a saved Keras model hdf5 file, or (3) a SystemML model.
> This would be a step towards a full-blown, official backend for Keras.  The main goal here would be to allow users to be able to transparently make use of distributed training, without having to learn the details of SystemML.
> Initial steps:
> 1. Learn Keras
> 2. Learn Caffe2DML: [http://apache.github.io/systemml/beginners-guide-caffe2dml]  Basically, Caffe2DML lets users import Caffe models (architecture and trained weights if available) into SystemML and train/predict on Spark with a scikit-learn compatible API without the user having to learn SystemML.  The main benefit is distributed training without the user needing to think about it much.  A bunch of the infrastructure is in place that I think Keras2DML would use.
> 3. Import a simple Keras model definition with a single Dense layer, and focus on hooking up the new Keras2DML class to the existing infrastructure.
> 4. Add reading of trained weights from Keras for the simple model, and hook up to existing infrastructure.
> 5. Expand out to increasingly complex models, aiming to be able to import all of the pretrained models from Keras, starting with VGG16 & ResNet50. [https://keras.io/applications/]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)