You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Xian Zheng (JIRA)" <ji...@apache.org> on 2019/02/11 10:47:00 UTC
[jira] [Issue Comment Deleted] (YARN-8135) Hadoop {Submarine}
Project: Simple and scalable deployment of deep learning training / serving
jobs on Hadoop
[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xian Zheng updated YARN-8135:
-----------------------------
Comment: was deleted
(was: Hi, happy new year, i have payed attention on submarine for several weeks, and now i confuse how users specify code for training, build a docker image every after modifying the code?)
> Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop
> -------------------------------------------------------------------------------------------------------------
>
> Key: YARN-8135
> URL: https://issues.apache.org/jira/browse/YARN-8135
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Wangda Tan
> Assignee: Wangda Tan
> Priority: Major
>
> Description:
> *Goals:*
> - Allow infra engineer / data scientist to run *unmodified* Tensorflow jobs on YARN.
> - Allow jobs easy access data/models in HDFS and other storages.
> - Can launch services to serve Tensorflow/MXNet models.
> - Support run distributed Tensorflow jobs with simple configs.
> - Support run user-specified Docker images.
> - Support specify GPU and other resources.
> - Support launch tensorboard if user specified.
> - Support customized DNS name for roles (like tensorboard.$user.$domain:6006)
> *Why this name?*
> - Because Submarine is the only vehicle can let human to explore deep places. B-)
> h3. {color:#ff0000}Please refer to on-going design doc, and add your thoughts: [https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#|https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit?usp=sharing]{color}
>
> *{color:#333333}See Also:{color}*
> * {color:#333333}Zeppelin integration with Submarine design: [https://docs.google.com/document/d/16YN8Kjmxt1Ym3clx5pDnGNXGajUT36hzQxjaik1cP4A/edit#heading=h.4jov859x47qe]{color}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org